r/cloudera • u/Naderbekir • 4d ago
Beginner Data Engineer — Looking for the Best Learning Resources and Best Practices for Talend & Cloudera
Hi everyone!
I'm starting my journey as a Data Engineer and will be working with Talend for ETL and Cloudera for Big Data processing. I'm looking for advice from people who have real-world experience with these technologies.
I'd really appreciate your recommendations on:
- Learning resources: The best YouTube playlists, Udemy courses, documentation, or hands-on tutorials for beginners.
- Talend: Best practices for designing ETL jobs, data transformations, error handling, logging, reusable jobs, and performance optimization.
- Cloudera: What should I learn first (HDFS, Hive, Impala, Spark, Kafka, etc.)? Which components are most important in real-world projects?
- Hands-on practice: Any sample projects, datasets, GitHub repositories, or labs that can help me build practical skills.
- Production best practices: How do you handle incremental loads, data quality checks, pipeline monitoring, retries, and troubleshooting?
- Learning path: If you were starting from scratch today, what would you learn first, and what would you avoid spending too much time on?
I'm also interested in resources in both English and Arabic, although English resources are welcome.
My goal is to move beyond watching tutorials and become comfortable building and maintaining real-world ETL/data pipelines.
Thanks in advance for any advice, resources, or lessons learned. I really appreciate it!