Converting Talend generated Java code to Python - possible?

Backend
1

I’m working with Talend and I know it generates Java code behind the scenes. I also understand that when dealing with Big Data components, Talend creates Java Spark code.

My question is whether there’s any method or approach to make Talend output Python code instead of Java? Specifically, I’m interested in getting Python Spark code for Big Data jobs rather than the default Java implementation.

Has anyone found a workaround for this? Maybe through configuration settings or alternative tools that can convert the generated Java to Python? I’m looking for ways to work with Python since that’s what my team prefers for our data processing tasks.

Any suggestions or experiences with similar challenges would be really helpful. Thanks in advance!

2

totally get that! talend can be a bit of a hassle for python work. have you looked into using other frameworks that integrate better with python, like apache flink or dask? they can handle big data while giving you the flexibility you want.

3

interesting challenge! what specific python features does your team need that java spark can’t handle? have you thought about using talend jobs for the data flow logic, then manually rewriting the important parts in pyspark? might be worth checking if the conversion effort beats just using native python tools from the start.