Data Engineer
2 weeks ago
Role: Data Engineer (Scala)
Location: Chennai
Work Mode: Hybrid
Employment Type: Full-time Permanent
Overview:
We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing frameworks, primarily on cloud platforms like Databricks. The ideal candidate will combine technical proficiency with leadership skills to drive the team's success.
Responsibilities:
- Architect, develop, and maintain large-scale data pipelines using Scala, Apache Spark, and PySpark.
- Collaborate closely with data scientists, analysts, and engineering teams to deliver scalable data solutions.
- Enhance pipeline performance and ensure reliability on cloud-based platforms, with a focus on Databricks.
- Provide mentorship and technical guidance to junior engineers, promoting best practices in data engineering.
- Conduct code reviews to maintain code quality, consistency, and scalability.
- Troubleshoot and resolve issues related to data processing and system performance.
Essential Skills:
- Expert-level proficiency in Scala programming (mandatory).
- Extensive experience working with Apache Spark and Databricks environments.
- Strong skills in PySpark and Python scripting for data transformation tasks.
- Proven track record of building and supporting robust, large-scale data processing workflows.
- Solid understanding of distributed systems and parallel computing concepts.
- Commitment to writing clean, efficient, and maintainable code.
Preferred Qualifications:
- Experience with major cloud platforms such as Azure, AWS, or Google Cloud Platform (GCP).
- Familiarity with ELT/ETL orchestration tools and frameworks.
- Knowledge of CI/CD pipelines tailored for data engineering workflows.
- Prior experience working in Agile development environments.
Job Type: Permanent
Pay: ₹3,000, ₹3,500,000.00 per year
Experience:
- Scala programming : 5 years (Required)
- Spark: 3 years (Required)
- Pyspark: 3 years (Required)
- Spark (Databricks): 3 years (Required)
- Total: 10 years (Required)
Work Location: In person
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per yearData Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Lead Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...
-
Senior Data Engineer
6 days ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full timeEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...
-
Senior Data Engineer
3 days ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full timeSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.
-
Lead Data Engineer
1 week ago
Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per yearAbout the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...
-
Data & Business Insights Associate
2 days ago
Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per yearWorks under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making, and problem-solving skills.Must...
-
Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Unifi Data Management Services Full time ₹ 20,00,000 - ₹ 50,00,000 per yearRole Summary:The Data Architect is responsible for designing, governing, and implementing enterprise-wide data architecture strategies to enable trusted, scalable, and high-performing data platforms. This role ensures data consistency, security, and accessibility across multiple business domains aligning data initiatives with business goals and digital...
-
Data Activity Monitoring
4 days ago
Chennai, Tamil Nadu, India NTT DATA, Inc. Full time ₹ 60,000 - ₹ 1,20,000 per yearRole: Data Activity Monitoring (DAM) Engineers – L1 & L2Location:Chennai, IndiaEducation:BE / B.Tech / MCAinElectronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1Experience:2 yearsBudget:₹5.85 LPAKey Responsibilities:Support day-to-day operations of Data Activity Monitoring tools .Monitor database and application activity to...