Cognine - Data Engineer - SQL/PySpark

1 day ago

Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

Data Engineer (Azure Data Factory and Azure Databricks)

Job Description :

We seek a Data Engineer with at least 5 years of experience in Azure Databricks, Azure Data Lake Storage gen2 (ADLS), and Azure Data Factory (ADF).

The candidate will design, build, and maintain data pipelines using Azure ADF/Databricks.

The candidate should be able to create Data Modelling & Governance, they will also work closely with our data science and engineering teams to develop and deploy machine learning models and other advanced analytics solutions.

Primary skills : Azure Data Factory, Azure Data Bricks, SQL, ADLS, Spark-SQL, Python (Pandas), Pyspark or Scala.

Secondary Skills : Basics of Azure Security (RBAC, Azure AD), Hadoop, HDFS, ADLS, Azure DBFS, PowerBI, and Tableau visualization tool is a plus.

Responsibilities :

- Design, build, and maintain data pipelines using Azure ADF/Databricks.

- Strong expertise in Azure Data Factory, Databricks, and related technologies such as Azure Synapse Analytics and Azure Functions.

- Hands-on experience in designing and implementing data pipelines and workflows in Azure Data Factory and Databricks.

- Experience in Data Extraction, Transformation, and Loading of data from multiple data sources into target databases, using Azure Databricks, Spark SQL, Pyspark, and Azure SQL.

- Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.

- Sound working experience in Cleansing, Transformation, Business Logic, Incremental Transformation of Data, and merging the data with datamart tables,.

- Developing scalable and reusable frameworks for ingesting data sets.

- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.

- Interacting with stakeholders and leaders to understand business goals and data requirements.

- Experience in working with Agile (Scrum, Sprint) and Waterfall Methodologies.

- Collaborate with data engineers, data architects, and business analysts to understand and translate business requirements into technical designs.

- Provide technical guidance and support to junior team members.

- Design, develop, and maintain SQL databases, including creating database schemas, tables, views, stored procedures, and triggers.

- Self-starter and team player with excellent communication, problem-solving skills, and interpersonal skills, and a good aptitude for learning.

(ref:hirist.tech)

  • Cognine - Machine Learning Engineer - Artificial Intelligence

    1 day ago

    Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Cognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide.Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence.We help organizations modernize IT ecosystems, build AI-powered...

  • Cognine - Developer - C#/ASP

    6 days ago

    Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset.As a Great...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...

  • ML Engineer

    4 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    5 - 10HyderabadFull-TimeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems,...

  • Pyspark Data Engineer

    5 days ago

    Hyderabad, Telangana, India DATAECONOMY Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: PySpark Data Engineer Experience: 5 – 8 Years Location: Hyderabad Employment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 5–8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...

  • Pyspark Data Engineer

    5 days ago

    Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...

  • Pyspark, Python, SQL, Palantir Data Engineer

    5 days ago

    Hyderabad, Telangana, India Disa Consulting Services Full time US$ 90,000 - US$ 1,20,000 per year

    2 rounds of coding sessions is must for every candidate.Position: Pyspark, Python, SQL, Palantir Data EngineerLocation: Hyderabad, India. Onsite from Day1. Need local Hyderabad, India or close by locations candidatesResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and...

  • Lead Dotnet Developer

    5 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionCognine Technologies is an AI-driven technology solutions provider empowering businesses through AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems, build AI-powered applications, streamline operations, and drive innovation. With a presence across North America, Europe, and APAC, our...

  • Azure Data Engineer

    3 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time US$ 90,000 - US$ 1,20,000 per year

    Experience Required: 5 to 6Years MandateMode of work: Remote (India)Skills Required: Azure Data Factory, Databricks, Pyspark, Python/Scala , SQLNotice Period : Immediate Joiners/ Permanent(Can join Immediately by 8th September 2025 )5 to 6 years of experience with Big Data technologiesExperience with Microsoft Azure cloud platform.Expertise in Azure...

  • Lead Data Engineer(pyspark)

    5 days ago

    Hyderabad, Telangana, India Careers at Tide Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    ABOUT THE ROLE We are seeking a highly skilled and experienced Senior Data Engineer with a deep expertise in PySpark to join our ML/Data engineering team. This team is responsible for feature development, data quality checks, deploying and integrating ML models with backend services and the overall Tide platform. In this role, you will be instrumental...