Data Engineer Jobs in Chennai Software Product Company

📋 Job Description

Jobzi is sourcing qualified candidates for Data Engineer positions in Chennai's private Software Product Company sector. This is a full-time opportunity with a reputed Software and Technology employer in Chennai offering competitive salary, structured growth, and a professional work environment. Tamil communication skills are preferred alongside English for professional and business interaction in Chennai.

📌 Key Responsibilities

• Design, build, and maintain scalable ETL and ELT data pipelines that move and transform data across the company's product ecosystem.
• Develop and manage data warehousing solutions on cloud platforms such as AWS Redshift, Google BigQuery, or Snowflake.
• Build data workflow orchestration using Apache Airflow, handling scheduling, dependency management, and failure alerting for production pipelines.
• Process large-scale data using Apache Spark or PySpark for batch and near-real-time analytical use cases.
• Implement data quality checks, schema validation, and data lineage tracking to ensure reliability of data consumed by analytics and ML teams.
• Collaborate with data scientists, product analysts, and ML engineers to understand data requirements and design schemas that support analytical workloads.
• Optimise pipeline performance, manage data partitioning strategies, and control cloud data processing costs through efficient job design.

🎓 Qualifications and Requirements

• B.E. or B.Tech in Computer Science, IT, or a related field with two to six years of data engineering experience.
• Strong proficiency in Python for data transformation, pipeline scripting, and automation.
• Hands-on experience with Apache Spark or PySpark for large-scale batch data processing.
• Experience designing and maintaining data warehouses or lakehouses on Redshift, BigQuery, Snowflake, or Azure Synapse.
• Familiarity with workflow orchestration using Apache Airflow including DAG design, task dependencies, and alert management.
• Knowledge of streaming data platforms such as Apache Kafka or AWS Kinesis for real-time pipeline requirements.
• Understanding of data modelling concepts including star schema, snowflake schema, and dimensional modelling for analytical use.
• Good Tamil and English communication skills for team coordination and client interaction in Chennai.

✅ Required Skills