Data Engineer

1 week ago

Chennai, Tamil Nadu, India iXceed Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Responsibilities :

- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.

- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.

- Optimize Spark applications for performance and cost-efficiency within the Databricks environment.

- Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning.

- Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.

- Implement data governance and security best practices within Databricks.

- Troubleshoot and resolve data-related issues, ensuring data availability and reliability.

- Stay updated with the latest advancements in Spark, Scala, Databricks, and related big data technologies.

Required Skills and Experience :

- Proven experience as a Data Engineer with a strong focus on big data technologies.

- Expertise in Scala programming language for data processing and Spark application development.

- In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and Spark Core.

- Proficiency in using Databricks platform features, including notebooks, jobs, workflows, and Unity Catalog.

- Experience with Delta Lake and its capabilities for building data lakes.

- Strong understanding of data warehousing concepts, data modeling, and relational databases.

- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.

- Experience with version control systems like Git.

- Excellent problem-solving and analytical skills.

- Ability to work independently and as part of a team.

Preferred Qualifications (Optional) :

- Experience with other big data technologies like Kafka, Flink, or Hadoop ecosystem components.

- Knowledge of data visualization tools.

- Understanding of DevOps principles and CI/CD pipelines for data engineering.

- Relevant certifications in Spark or Databrick

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Lead Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer - Azure Req ID: 336026 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job...

  • Python & SSIS Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 10,00,000 - ₹ 42,00,000 per year

    MANDATORY PREVIOUS WORK EXPERIENCE IN SSIS AND PYTHON. (Candidates without this experience in the past will NOT be considered for this role)JOB RESPONSIBILITIES5+ years previous work experience as a Data Engineer.Design and build data pipelines using SSIS, ADF, Talend, Informatica, Data Stage, or Ab Initio to move and transform data reliably.Manage and...

  • Data & Business Insights Associate

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Works under supervision with internal and external teams to understand customer requirements Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. Ability to elaborate on the details of a project Appropriate mathematical knowledge Strong communication and critical thinking...

  • Data & Business Insights Associate

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making, and problem-solving skills.Must...

  • Senior Data scientist

    7 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Senior Software Engineer

    7 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Systems Engineering Specialist

    7 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineering Specialist to join our team. At NTT DATA, we know that with the right people on board, anything is possible. The...