Data Engineer

18 hours ago

Chennai, India One Degree North HR Services Full time

We are looking for a Data Engineer with hands-on experience in Azure Data Factory, Azure Databricks, PySpark, and .NET Framework to design and maintain efficient, scalable data pipelines and analytics platforms.

The ideal candidate will be responsible for application integration, workflow automation, and leveraging Azure Synapse for advanced data warehousing and analytics.

Experience with machine learning techniques and production support will be an added advantage.


Key Responsibilities :


- Develop and maintain data pipelines using Azure Data Factory (ADF) and Azure Databricks (PySpark) to support real-time and batch data processing.

- Use Azure Synapse Analytics for data warehousing, reporting, and big data analytics.

- Apply machine learning models and frameworks to drive predictive insights and automation.

- Build and consume APIs and data services using the .NET Framework, integrating them into the data ecosystem.

- Automate and orchestrate data workflows for performance, reliability, and scalability.

- Ensure high data quality, consistency, and integrity across multiple data sources and platforms.

- Provide BAU (Business As Usual) support : monitor systems, resolve incidents, and ensure SLAs are met.

- Collaborate with data analysts, architects, business stakeholders, and cross-functional teams to translate requirements into technical solutions.

- Maintain technical documentation including data flows, architecture diagrams, pipeline logic, and operational runbooks.

- Stay current on emerging Azure and big data technologies, best practices, and trends.


Required Skills & Qualifications :


- Strong experience in Azure Data Factory (ADF) and Azure Databricks with PySpark.

- Solid understanding of Azure Synapse Analytics, data lake architecture, and structured/unstructured data handling.

- Programming experience with Python (for PySpark) and C#/.NET Framework for integration/API development.

- Experience with data orchestration, automation, and ETL/ELT design.

- Familiarity with machine learning concepts, models, and libraries (e., Scikit-learn, MLflow)

- Experience with CI/CD pipelines, version control (Git), and DevOps practices.

- Understanding of data governance, security, and compliance on cloud platforms.


Preferred Qualifications :


- Microsoft Azure certification

- Experience with Power BI or other reporting tools.

- Familiarity with Kafka/Event Hub for streaming data.

- Exposure to other cloud platforms like AWS/GCP is a plus.


Educational Qualification :


- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience)


(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Career Opportunity

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • GCP Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time US$ 90,000 - US$ 1,20,000 per year

    Data Engineer Job DescriptionPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present.- Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member...

  • Data Engineer for Azure DevOps

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 336023NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer for Azure DevOps to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: 7+ years of...