Senior Data Engineer- ADF

2 weeks ago

Chennai, India Kavi Software Technologies Private Limited Full time
Job Description

Job Summary:

We are looking for an experienced and highly skilled Senior Data Engineer to lead the design and development of our data infrastructure and pipelines. As a key member of the Data & Analytics team, you will play a pivotal role in scaling our data ecosystem, driving data engineering best practices, and mentoring junior engineers. This role is ideal for someone who thrives on solving complex data challenges and building systems that power business intelligence, analytics, and advanced data products.


Key Responsibilities:

  • Design and build robust, scalable, and secure data pipelines and models.
  • Lead the complete lifecycle of ETL/ELT processes, encompassing data intake, transformation, and storage including the concept of SCD type2.
  • Collaborate with data scientists, analysts, backend and product teams to define data requirements and deliver impactful data solutions.
  • Maintain and oversee the data infrastructure, including cloud storage, processing frameworks, and orchestration tools.
  • Build logical and physical data model using any data modeling tool
  • Champion data governance practices, focusing on data quality, lineage tracking, and catalog management.
  • Guarantee adherence of data systems to privacy regulations and organizational guidelines.
  • Guide junior engineers, conduct code reviews, and foster knowledge sharing and technical best practices within the team .

 

Required Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.
  • Minimum of 5 years of practical experience in a data engineering or comparable position.
  • Demonstrated expertise in SQL and Python (or similar languages such as Scala/Java).
  • Extensive experience with data pipeline orchestration tools (e.g., Airflow, dbt, ).
  • Proficiency in cloud data platforms, including AWS (Redshift, S3, Glue), or GCP (BigQuery, Dataflow), or Azure (Data Factory, Synapse).
  • Familiarity with big data technologies (e.g., Spark, Kafka, Hive) and other data tools.
  • Solid grasp of data warehousing principles, data modeling techniques, and performance tuning. (e.g. Erwin Data Modeler, MySQL Workbench)

·        Exceptional problem-solving abilities coupled with a proactive and team-oriented approach.




Requirements
Data Engineer, ADF

  • Senior Data Engineer- ADF

    2 weeks ago

    Chennai, India Kavi Software Technologies Private Limited Full time

    Job Description Job Summary: We are looking for an experienced and highly skilled Senior Data Engineer to lead the design and development of our data infrastructure and pipelines. As a key member of the Data & Analytics team, you will play a pivotal role in scaling our data ecosystem, driving data engineering best practices, and mentoring junior engineers....

  • Data Engineer ADF

    1 week ago

    Bengaluru, Chennai, Pune, India Photon Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Role: We are seeking a skilled and experienced ADF Engineer to join our team and contribute to the development and maintenance of our critical applications. You will be responsible for designing, developing, and supporting ADF applications using Oracle ADF Framework. This role requires a deep understanding of Java, Oracle ADF, and related...

  • Senior data engineer

    4 weeks ago

    Chennai, India InfoBeans Full time

    About the Job: Job Title: Senior Data Engineer Skills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, Python Experience Required : 7+ Years Location: Chennai, Bangalore, Hyderabad, Indore Notice Period: Serving Notice - 45 days Job Description: Experienced Data Professional with strong SQL skills, focusing on data...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India InfoBeans Full time

    About the Job:- Job Title: Senior Data Engineer- Skills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, Python- Experience Required : 7+ Years- Location: Chennai, Bangalore, Hyderabad, Indore- Notice Period: Serving Notice - 45 daysJob Description:- Experienced Data Professional with strong SQL skills, focusing on data...

  • Senior Data Engineer

    4 weeks ago

    Chennai, India InfoBeans Full time

    About the Job: - Job Title: Senior Data Engineer - Skills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, Python - Experience Required : 7+ Years - Location: Chennai, Bangalore, Hyderabad, Indore - Notice Period: Serving Notice - 45 days Job Description: - Experienced Data Professional with strong SQL skills, focusing on...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India InfoBeans Full time

    About the Job:Job Title: Senior Data EngineerSkills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, PythonExperience Required : 7+ YearsLocation: Chennai, Bangalore, Hyderabad, IndoreNotice Period: Serving Notice - 45 daysJob Description:Experienced Data Professional with strong SQL skills, focusing on data integration,...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Antal International Full time

    Job Description Role: Senior Data Engineer Job type: Permanent Work Type: Hybrid (Office + Home) Location: Chennai, Bangalore, Hyderabad, Indore, Mumbai (candidates from these locations should only apply) Experience: 7 - 15 Years Salary: Rs. 20,00,000 - 35,00,000 Notice Period (How Soon Client Wants Candidate to Join): Immediate...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Antal International Full time

    Job Description Role: Senior Data Engineer Job type: Permanent Work Type: Hybrid (Office + Home) Location: Chennai, Bangalore, Hyderabad, Indore, Mumbai (candidates from these locations should only apply) Experience: 7 - 15 Years Salary: Rs. 20,00,000 - 35,00,000 Notice Period (How Soon Client Wants Candidate to Join): Immediate Joiner - 45...

  • Senior Data Engineer

    4 weeks ago

    Chennai, India InfoBeans Full time

    About the Job:Job Title: Senior Data EngineerSkills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, PythonExperience Required : 7+ YearsLocation: Chennai, Bangalore, Hyderabad, IndoreNotice Period: Serving Notice - 45 daysJob Description:Experienced Data Professional with strong SQL skills, focusing on data integration,...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India InfoBeans Full time

    About the Job: Job Title: Senior Data Engineer Skills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, Python Experience Required : 7+ Years Location: Chennai, Bangalore, Hyderabad, Indore Notice Period: Serving Notice - 45 days Job Description: Experienced Data Professional with strong SQL skills, focusing on data...