Marcin Szymaniuk

CEO | Senior Data Engineer | International Conference Speaker
TantusData
Poland

About

Specialising in helping clients monetise big data since the early 2000s, Marcin Szymaniuk leads a team of seasoned data engineers with expertise in data engineering, machine learning (ML), machine learning operations (MLOps), and cloud technologies.Marcin is adept at solving both non-standard challenges and everyday problems that require fast, practical solutions. His experience spans a wide range of industries and project sizes, with a strong focus on artificial intelligence (AI), ML, and deployment strategies.He has presented at numerous industry events, including Infoshare, J On The Beach, Devoxx, Huawei Eco-Connect Poland 2023, Berlin Buzzwords, Codestar, GeeCON, and Java Day Istanbul.
Linkedin
Talk

Marcin Szymaniuk | Spark Performance Tuning and Troubleshooting – Scrapping the Bottom of the Barrel for Tricky Cases

Apache Spark, Production Workloads, Performance Optimization
This talk dives into Apache Spark’s quirks in real-world production workloads involving terabytes of data. Marcin Szymaniuk begins with a quick recap of last year’s lessons and then explores practical corner cases in which Spark still struggles today. Topics include user-defined function (UDF) bottlenecks, driver-heavy tasks, large directed acyclic graphs (DAGs), and challenges with non-standard data sources. Attendees can expect a no-fluff, hands-on walkthrough of edge cases Marcin has encountered in production, offering insights to help their Spark jobs run more smoothly.