Data Engineer Azure Pyspark

3 weeks ago


Hyderabad, Telangana, India Overture Rede Private Limited Full time
Job Title: Data Engineer

Location: Remote

Responsibilities:
As a Data Engineer at Overture Rede Private Limited, you will design, build, and maintain scalable data pipelines using PySpark on Data bricks. You will work with Delta Lake to ensure data reliability, consistency, and scalability. You will utilize Azure Synapse for integrated analytics querying and big data processing. You will develop and deploy data solutions on Azure, including data lakes, data warehouses, and data pipelines. You will collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. You will monitor and optimize data pipelines for performance and cost efficiency.

Requirements:
Experience with PySpark: Hands-on experience in writing PySpark scripts and managing Spark clusters. Delta Lake Expertise: Understanding of Delta Lake features such as ACID transactions and schema evolution. Experience with PySpark and Delta Lake Expertise

  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Work with Delta Lake to ensure data reliability, consistency, and scalability.Utilize Azure Synapse for integrated analytics querying and big data processing.Develop and deploy data solutions on Azure, including data lakes,...


  • Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    AppSierra Solutions Data Engineer Job DescriptionOverviewWe are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to work with our team at AppSierra Solutions Pvt Ltd. The ideal candidate will have strong hands-on experience with SQL and database technologies, proficiency in Pyspark for data processing and analytics, and...

  • Data Scientist

    3 weeks ago


    Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: Remote or Specify LocationJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters. Additionally, they should have expertise...


  • Hyderabad, Telangana, India KPI Partners Full time

    Key Responsibilities:Lead the development of data engineering solutions using PySpark, Python, and SQL.Design and implement scalable data pipelines on cloud platforms such as Azure and AWS.Collaborate with cross-functional teams to ensure data quality and integrity.Stay up-to-date with industry trends and best practices in data engineering.About the Role:KPI...

  • Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    About the Role:We are seeking a highly skilled Data Engineer with expertise in Azure, SQL, and Pyspark to design and implement data solutions for our organization. As a Data Engineer, you will work closely with our data scientists and analysts to understand data requirements and ensure the quality, availability, and accessibility of our data.Key...


  • Hyderabad, Telangana, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteResponsibilities:Design, build, and maintain scalable data pipelines using PySpark on Databricks.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Monitor and optimize data pipelines for performance and cost efficiency.Requirements:Experience with...

  • Azure Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India 2coms Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data ingestion pipelines using...


  • Hyderabad, Telangana, India Innover Global Inc Full time

    Job Title: Cloud Data Science and Engineering SpecialistAbout the Role:We are seeking a highly skilled Cloud Data Science and Engineering Specialist to join our team at Innover Global Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on the Azure cloud...

  • Data Engineering Lead

    3 weeks ago


    Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we strive to make the health system work better for everyone. As a Data Engineering Lead, you will play a crucial role in helping us achieve this mission. We are looking for a seasoned professional with expertise in Java, Pyspark, Azure, and Databricks to lead our team of engineers and drive the development of scalable, fault-tolerant...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Data Engineer - Pyspark Databricks SpecialistAbout the RoleRisk Resources LLP is seeking a skilled Data Engineer to join our team. As a Data Engineer - Pyspark Databricks Specialist, you will be responsible for developing and implementing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and Develop Data...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    About the RoleWe are seeking a skilled Azure Databricks Data Engineer to join our team at Alignity Solutions. The ideal candidate will have experience in designing, developing, and maintaining data pipelines and data streams using Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).The successful candidate will be responsible for designing...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India UnitedHealth Group Full time

    Optum: Delivering Care and Improving Health OutcomesAt Optum, we strive to make a meaningful difference in the lives of millions of people around the world. Our team is dedicated to delivering care and improving health outcomes through innovative technology and data-driven solutions.Job SummaryWe are seeking a highly skilled and experienced Principal Data...

  • Azure Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India HTC Global Services Full time

    Azure Data Bricks ETL Developer OpportunityWe are seeking an experienced Azure Data Bricks ETL Developer to join our team at HTC Global Services.Key Responsibilities:Design and develop ETL processes using Azure Data BricksDevelop and maintain data pipelines to ensure data quality and integrityCollaborate with cross-functional teams to identify and prioritize...


  • Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking an experienced Azure Data Engineer to join our team in Hyderabad. As a key member of our data engineering group, you will play a vital role in designing, implementing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in big data technologies, particularly PySpark and...


  • Hyderabad, Telangana, India Vertex Offshore Services Pvt Ltd Full time

    Job Title: Azure Data Engineering LeadWe are seeking a highly skilled and experienced Azure Data Engineering Lead to join our team at Vertex Offshore Services Pvt Ltd.Job Summary:Vertex Offshore Services Pvt Ltd is looking for a seasoned Azure Data Engineering Lead to design, build, and maintain scalable data solutions on the Azure platform. As an Azure Data...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: Senior Data Engineer - PySparkAbout the Role:We are seeking a highly skilled Senior Data Engineer - PySpark to join our team at DataEconomy. As a Senior Data Engineer - PySpark, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark. You will work closely with technical teams to develop...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Unlock Your Potential as a Data EngineerWe are seeking a skilled Data Engineer to join our team at Alignity Solutions. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and data streams using Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).Key ResponsibilitiesDesign and build modern...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India 2coms Full time

    Job Title: Data Engineer - Azure Ecosystem DeveloperAt 2coms, we're seeking a skilled Data Engineer to join our team. As a Data Engineer - Azure Ecosystem Developer, you'll play a crucial role in building and maintaining our company's data infrastructure on Microsoft Azure.The ideal candidate will have a strong foundation in big data engineering and...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...