Azure Data Engineer

2 weeks ago

Vijayawada, India Sigmoid Full time

We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment.Key Responsibilities:Data Pipeline Development:Design, build, and optimize scalable data pipelines using Apache Spark.Implement and manage large-scale data processing solutions across data lakehouses.Data Lakehouse Management:Work with modern data lakehouse platforms (e.g.Apache Iceberg) to handle large datasets.Optimize data storage, partitioning, and versioning to ensure efficient access and querying.SQL & Data Management:Write complex SQL queries to extract, manipulate, and transform data.Develop performance-optimized queries for analytical and reporting purposes.Data Integration:Integrate various structured and unstructured data sources into the lakehouse environment.Work with stakeholders to define data needs and ensure data is available for downstream consumption.Data Governance and Quality:Implement data quality checks and ensure the reliability and accuracy of data.Contribute to metadata management and data cataloging efforts.Performance Tuning:Monitor and optimize the performance of Spark jobs, SQL queries, and overall data infrastructure.Work with cloud infrastructure teams to optimize costs and scale as needed.Qualifications:Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.8+ years of experience in data engineering, with a focus on python, Spark and SQL Programming languages.Hands-on experience with Apache Iceberg, Snowflake, or similar technologies.Strong understanding of data lakehouse architectures and data warehousing principles.Proficiency in Azure.Experience with version control systems like Git and CI/CD pipelines.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Nice to Have:Experience with containerization (Docker, Kubernetes) and orchestration tools like Airflow.Certifications in Azure cloud technologies

  • Azure Data Engineer

    3 weeks ago

    Vijayawada, India People Prime Worldwide Full time

    Strong experience with Azure services:Azure Data Factory (ADF)Azure Databricks / SparkAzure Synapse AnalyticsAzure Data Lake Storage (Gen1/Gen2)Azure SQL / SQL ServerProficiency in SQL, Python or PySpark.Experience with data modelling (star schema, snowflake, normalization).Understanding of modern data architectures (lakehouse, data mesh, ELT).

  • Azure Data Engineer

    3 weeks ago

    Vijayawada, India People Prime Worldwide Full time

    Strong experience with Azure services:Azure Data Factory (ADF)Azure Databricks / SparkAzure Synapse AnalyticsAzure Data Lake Storage (Gen1/Gen2)Azure SQL / SQL ServerProficiency in SQL, Python or PySpark.Experience with data modelling (star schema, snowflake, normalization).Understanding of modern data architectures (lakehouse, data mesh, ELT).

  • Senior Azure Cloud Data Engineer

    7 days ago

    vijayawada, India beBeeDataMigration Full time

    **Azure Data Migration Specialist**Job DescriptionThe ideal candidate will have hands-on experience in modern data engineering tools and platforms within the Azure ecosystem, with a strong foundation in data integration, transformation, and migration.We are seeking a highly skilled professional to lead the migration of large-scale SQL workloads from...

  • Azure AI Co-Pilot Engineer

    7 days ago

    Vijayawada, India Onebridge Full time

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Solutions Architect

    1 week ago

    vijayawada, India beBeeData Full time

    Azure Data EngineerDesign and implement data solutions using Azure services. Develop efficient data pipelines, ETL processes, and optimize data processes for performance and scalability. Designing and implementing data engineering solutionsDeveloping and maintaining efficient data pipelinesCollaborating with stakeholders to deliver data-driven...

  • Data Engineer Lead

    3 weeks ago

    Vijayawada, India JRD Systems Full time

    About the RoleWe are seeking an experienced Data Engineer Lead to design, develop, and maintain scalable data solutions on Azure and Databricks as part of our enterprise data modernization initiatives. The ideal candidate will have a strong background in data pipeline development, data integration frameworks , and cloud-based data engineering , with...

  • Cloud Architect

    1 week ago

    vijayawada, India beBeeDataEngineer Full time

    Senior Azure Data EngineerWe are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in Azure platforms, including Azure Databricks, ADLS, Synapse, and its various components.The successful candidate will be responsible for building and...

  • Data Architect and Engineer

    3 days ago

    vijayawada, India beBeeDataEngineering Full time

    Senior Data Engineering RoleWe are seeking an experienced and skilled professional to assume a senior-level data engineering position within our organization.The ideal candidate will have a strong foundation in software development, particularly with Python, as well as proficiency in Azure services, CI/CD pipelines, deployment strategies, and the design of...

  • Senior Data Engineering Specialist

    1 week ago

    vijayawada, India beBeeDataEngineering Full time

    Job Opportunity for Data Engineering ExpertWe are seeking an exceptional Data Engineer with expertise in designing and building large-scale data pipelines that support both batch and real-time analytics. The ideal candidate will have hands-on experience in Azure cloud, Big Data technologies, and distributed data processing frameworks.Data Pipeline...

  • Advanced Data Engineering Specialist

    1 week ago

    vijayawada, India beBeeDataEngineer Full time

    Job Title:Cloud Data EngineerAbout the Role:We are seeking a seasoned Cloud Data Engineer to design, implement, and maintain high-performance data pipelines and build scalable data platforms.Design and develop robust ETL processes using cloud-based tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.Develop and implement data lakes...