Cognine - Data Engineer - SQL/PySpark

3 weeks ago

Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

Data Engineer (Azure Data Factory and Azure Databricks)

Job Description :

We seek a Data Engineer with at least 5 years of experience in Azure Databricks, Azure Data Lake Storage gen2 (ADLS), and Azure Data Factory (ADF).

The candidate will design, build, and maintain data pipelines using Azure ADF/Databricks.

The candidate should be able to create Data Modelling & Governance, they will also work closely with our data science and engineering teams to develop and deploy machine learning models and other advanced analytics solutions.

Primary skills : Azure Data Factory, Azure Data Bricks, SQL, ADLS, Spark-SQL, Python (Pandas), Pyspark or Scala.

Secondary Skills : Basics of Azure Security (RBAC, Azure AD), Hadoop, HDFS, ADLS, Azure DBFS, PowerBI, and Tableau visualization tool is a plus.

Responsibilities :

- Design, build, and maintain data pipelines using Azure ADF/Databricks.

- Strong expertise in Azure Data Factory, Databricks, and related technologies such as Azure Synapse Analytics and Azure Functions.

- Hands-on experience in designing and implementing data pipelines and workflows in Azure Data Factory and Databricks.

- Experience in Data Extraction, Transformation, and Loading of data from multiple data sources into target databases, using Azure Databricks, Spark SQL, Pyspark, and Azure SQL.

- Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.

- Sound working experience in Cleansing, Transformation, Business Logic, Incremental Transformation of Data, and merging the data with datamart tables,.

- Developing scalable and reusable frameworks for ingesting data sets.

- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.

- Interacting with stakeholders and leaders to understand business goals and data requirements.

- Experience in working with Agile (Scrum, Sprint) and Waterfall Methodologies.

- Collaborate with data engineers, data architects, and business analysts to understand and translate business requirements into technical designs.

- Provide technical guidance and support to junior team members.

- Design, develop, and maintain SQL databases, including creating database schemas, tables, views, stored procedures, and triggers.

- Self-starter and team player with excellent communication, problem-solving skills, and interpersonal skills, and a good aptitude for learning.

(ref:hirist.tech)

  • Cognine - Machine Learning Engineer - Artificial Intelligence

    3 weeks ago

    Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Cognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide.Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence.We help organizations modernize IT ecosystems, build AI-powered...

  • Cognine - Developer - C#/ASP

    4 weeks ago

    Hyderabad, Telangana, India COGNINE TECHNOLOGIES PRIVATE LIMITED Full time

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset.As a Great...

  • Senior Data Engineer

    4 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. With a strong presence across North America, Europe, and APAC, our elite teams deliver scalable, high-impact solutions using modern engineering principles and a problem-solving mindset. As a Great...

  • ML Engineer

    4 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    5 - 10HyderabadFull-TimeCognine was formed by passionate people with engineering backgrounds, intending to provide core software engineering services to clients worldwide. Cognine is an AI-driven technology solutions provider, empowering businesses with AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems,...

  • Pyspark Data Engineer

    4 days ago

    Hyderabad, Telangana, India Enexus Global Inc. Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...

  • Pyspark, Python, SQL, Palantir Data Engineer

    4 days ago

    Hyderabad, Telangana, India Disa Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    2 rounds of coding sessions is must for every candidate.Position: Pyspark, Python, SQL, Palantir Data EngineerLocation: Hyderabad, India. Onsite from Day1. Need local Hyderabad, India or close by locations candidatesResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and...

  • Lead Dotnet Developer

    5 days ago

    Hyderabad, Telangana, India Cognine Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionCognine Technologies is an AI-driven technology solutions provider empowering businesses through AI, Automation, Product Engineering, and Data Intelligence. We help organizations modernize IT ecosystems, build AI-powered applications, streamline operations, and drive innovation. With a presence across North America, Europe, and APAC, our...

  • Azure Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Experience Required: 5 to 6Years MandateMode of work: Remote (India)Skills Required: Azure Data Factory, Databricks, Pyspark, Python/Scala , SQLNotice Period : Immediate Joiners/ Permanent(Can join Immediately by 8th September 2025 )5 to 6 years of experience with Big Data technologiesExperience with Microsoft Azure cloud platform.Expertise in Azure...

  • Date Engineer(Python, Pyspark and AWS)

    2 weeks ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...