Azure Data Ingestion Engineer

3 weeks ago


BangaloreAnywhere in IndiaMultiple Locations, IN Qualite Manpower Full time

Profile : Azure Data Ingestion Engineer.

Experience : 6 to 11 years.

Location : PAN India.

Notice Period : 30 days.

Job Description :

- 4+ years of software development experience and azure cloud computing Proficiency) Scala, Spark,- Python.

- Experience working in an Agile environment.

- Experience with- Python script development.

- 3+ years of Exp of Data Engineering/Big Data development experience.

- 3+ years in ETL/DW with Data Engineering.

- 3+ years Python/Scala with Azure Databricks.

- 2+ years of experience working with big data technologies (e.g, Hadoop, Spark, Presto).

- Hands Experience with a range of Azure based big data & analytics platforms like ADLS, ADF, Azure Data Warehouse specifically ingestion to cloud storages/Data Lake.

- Design, develop, and maintain scalable data pipelines and ETL processes using Python, Scala, and Spark on Azure Databricks, ensuring efficient data ingestion and transformation in cloud storage/Data Lake environments.


- Metrics include pipeline performance, data accuracy, and timely processing. Implement and optimize big data solutions using Azure-based platforms like ADLS, ADF, and Azure Data Warehouse.


- Metrics focus on the effectiveness of data ingestion processes, system performance, and integration with existing data infrastructure.


- Develop and maintain Python scripts for automating data workflows and enhancing data processing capabilities.


- Metrics include script efficiency, accuracy, and impact on overall data engineering operations. Collaborate with cross-functional teams in an Agile environment to deliver high-quality data solutions, ensuring alignment with project requirements and timelines.


- Metrics cover project delivery success, team collaboration effectiveness, and adherence to Agile practices.

(ref:hirist.tech)
  • Azure Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Scaling Theory Technologies Pvt Ltd Full time

    Roles and Responsibilities :- Information Model object build/enhancements (PO, Invoice, SES, RO, Vendor, etc) based on functional design- Technical/Functional validation of IM objects- Troubleshooting issues with code and implementing fixes- Support daily data loads from SAP/NonSAP systems into Information ModelTechnical Skills :- SQL Expert - Build [must...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Naukari Wale Full time

    Job Description :Requirement : - Python : They should have good experience in Python Coding, Array handling.- SQL Expert - Build [must have]- Azure / Databrick / Cloud Certifications- Azure Synapse, Azure Logic apps- Data Modelling - Data structures & common algorithms. - Understand E2E Data Flow from - Ingestion to Exploitation [must have]- Azure Databricks...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Recro Full time

    Responsibilities :- Design, develop, and implement data pipelines using Azure Data Factory to extract, transform, and load data from various sources into Azure data stores.- Build and optimize data warehouses on Azure Synapse to support complex analytical queries and reporting.- Develop and maintain ETL processes using Azure Data Factory and Azure SQL to...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN METHODHUB SOFTWARE PRIVATE LIMITED Full time

    Job Description :- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on Azure- Experience in developing ETL, OLAP based and Analytical Applications.- Experience in ingesting batch and streaming data from various data sources.- Strong Experience in writing complex SQL using any RDBMS (Oracle,...


  • Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate Openings on Azure Databricks EngineerJob Description :- Design, develop, and maintain scalable data processing solutions using Azure Databricks and Azure Data Factory.- Build and optimize end-to-end data pipelines for batch and real-time data ingestion, transformation, and loading.- Develop complex ETL processes using PySpark on Databricks,...

  • Big Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Stratosphere IT Services PVT Ltd Full time

    Job Description : - Azure data Engineer - Azure Data Factory - azure databricks- python - sql- Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database- Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.- Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.- Some experience...


  • Anywhere in India/Multiple Locations, IN Prep.Study Full time

    Job Description : - Design, architect, and develop end-to-end data solutions on the Azure Stack platform. - Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. - Collaborate with data scientists, analysts, and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Vysystems Full time

    Data Engineer Need short joinersJob Location : Bangalore - Manyata Tech ParkMode : Hybrid.Experience : 4-8 yearsJob Description : We are looking for a skilled Data Engineer with expertise in Azure Data Factory, Azure Databricks, PySpark, Snowflake, and SQL. The ideal candidate will play a key role in designing, building, and maintaining scalable data...

  • Lead Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Talentoj Full time

    Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Info Services Full time

    Responsibilities :- Data Ingestion & Processing : Design and implement efficient data pipelines using big data frameworks (e.g, Spark) for ingesting, transforming, and processing large datasets.- Programming Powerhouse : Utilize your strong coding skills in Scala (preferred), Python, or Java to develop high-performance and scalable data processing...


  • Anywhere in India/Multiple Locations, IN Magnacore Technologies Private Limited Full time

    Job Description : We are seeking a highly skilled and detail-oriented Azure Data Solutions Test Engineer to join our team. In this role, you will be responsible for designing, developing, and executing test strategies to ensure the quality and reliability of our Azure-based data solutions. The ideal candidate will have a strong background in data testing,...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Pyramid Consulting Full time

    Role and Accountabilities : Title: Azure Data Engineer with Azure Machine Learning Expertise Job Description : Key Responsibilities :Data Engineering and Management :- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.- Implement data warehousing solutions and ensure data quality and...

  • Azure Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations, IN estrel.ai Full time

    Job Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...

  • Azure Data Engineer

    3 days ago


    Remote/Anywhere in India/Multiple Locations, IN SMARTWORK IT SERVICES Full time

    Job Title : Azure Data Engineer. Experience : 10-14 years. Availability : Immediate Joiners. Job Type : Contract position. Work Mode : Remote (India). Job Description :- We are seeking an experienced Azure Data Engineer to join our team for a short-term project.- The ideal candidate will have extensive experience in data engineering, with a strong emphasis...


  • Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Data Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...

  • Emorphis Technologies

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Emorphis Technologies Pvt. Ltd. Full time

    Job Description :Role : Data engineer With snowflake Job Description : - Senior Data Analyst/ engineer with Snowflake and Azure experience- 7+ years of overall technology experience that includes atleast 3+ years of software development, data engineering and architecture- Excellent understanding of business functions, KPIs and Metrics and Translate them into...

  • Big Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...


  • Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full time

    Job Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full time

    We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...


  • Anywhere in India/Multiple Locations, IN Spectrum Consulting Full time

    Job Description Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines...