Azure Data Engineer

4 weeks ago

Allahabad, Uttar Pradesh, India Affine Full time

Experience - 5 - 8 years

Must Have Skills:

  • Azure Databricks
  • Azure Data Factory
  • PySpark
  • Spark - SQL
  • ADLS

Responsibilities:

  • Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
  • Design and build ETL pipelines using ADF
  • Build and maintain a Lakehouse architecture in ADLS / Databricks.
  • Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
  • Work with DevOps team to deploy solutions in production environments.
  • Control data processes and take corrective action when errors are identified. Corrective action may include executing a work around process and then identifying the cause and solution for data errors.
  • Participate as a full member of the global Analytics team, providing solutions for and insights into data related items.
  • Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions and to propagate best practices.
  • You will lead projects that include other team members and participate in projects led by other team members.
  • Apply change management tools including training, communication and documentation to manage upgrades, changes and data migrations.

  • Azure Data Platform Architect

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time US$ 60,000 - US$ 90,000

    Job Title:Data Engineering Specialist About the Role:We are seeking a highly skilled Data Engineer to join our team and support our Azure-based data engineering platform powered by Databricks.This role involves blending DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable.You will be...

  • Senior Azure Data Migration Specialist

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job DescriptionWe are seeking a skilled professional with expertise in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration.The successful individual will lead the migration of large-scale SQL workloads from on-premise environments to...

  • Azure Data Specialist

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Key Responsibilities:Design and develop scalable data architectures on Azure Databricks.Requirements:Proven experience in implementing data pipelines using Pyspark.A minimum of 3-12 years of hands-on experience with Delta Lake.Strong understanding of Azure services, including relational databases and SQL.Ability to work with ETL methods and dimensional data...

  • Lead Data Engineering Specialist

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeAzureDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking an experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with hands-on experience in tools like Azure Databricks, Azure Data Factory, and PySpark.The successful candidate will be responsible for designing, building, and maintaining large-scale data processing...

  • Cloud Data Engineering Specialist

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Role:">Azure Data EngineerJunior Azure Data EngineerRequirements:">7+ years of experience in data engineering with Azure.5+ years of experience in data engineering with Azure for junior role.Benefits:">Opportunity to work on a 2-month project remotely.Additional Information:">Location: Remote.

  • Data Pipeline Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeBackend Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Backend Data & Integration Engineer PositionWe are seeking an experienced and skilled Senior Backend Data & Integration Engineer to join our team. As a key member of our engineering team, you will play a crucial role in designing and implementing robust data pipelines.The ideal candidate will have 4-8 years of experience in backend/data engineering...

  • Data Engineering Position

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,10,000

    Data Engineering SpecialistWe are seeking a seasoned professional to craft robust data pipelines that drive business strategy.This opportunity is ideal for individuals who excel in tackling complex data hurdles and enjoy mentoring others. If you have 5-7 years of experience in data engineering and possess skills in ETL tools, SQL, data modeling, and cloud...

  • Azure Data Technical Specialist

    2 weeks ago

    Allahabad, Uttar Pradesh, India beBeeLeadership Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a seasoned Azure Data Support Lead to join our team.

  • Fabric Data Engineer

    4 weeks ago

    Allahabad, Uttar Pradesh, India DHJ TECHNOLOGIES Full time

    Job Title: Fabric Data EngineerLocation: [Remote]Type: [Contract]Project Duration: 3 monthsAbout the Role:We are seeking a skilled Fabric Data Engineer to support a key modernization initiative: migrating an on-premises SQL Server 2016 data warehouse to Microsoft Fabric. This role involves designing and building new data pipelines, as well as testing and...

  • Senior Data Engineer

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Azure Databricks engineers play a pivotal role in designing and implementing data processing systems leveraging cutting-edge big data technologies like Apache Spark. Key responsibilities encompass architecting scalable data pipelines, developing sophisticated data models, and optimizing database performance for seamless query execution.Key...