Cloud Data Engineer: Design and Optimize Scalable Pipelines

5 days ago


Hyderabad, Telangana, India RandomTrees Full time
Data Engineer

We are seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and workflows across cloud platforms like AWS, GCP, or Azure.

Key Responsibilities:
  • Create efficient data pipelines and ETL/ELT processes to extract, transform, and load data from various sources.
  • Collaborate with cross-functional teams to ensure seamless data flow and accessibility.
  • Develop complex SQL queries and stored procedures to optimize data extraction and manipulation.
  • Design and implement data models and data lakes/warehouses to store and manage large datasets.
  • Ensure high-quality data by implementing data validation, security, and compliance standards.
  • Use Python for scripting, automation, and data manipulation tasks.
  • Work with orchestration tools such as Apache Airflow, AWS Step Functions, or similar technologies.
  • Implement continuous integration and delivery (CI/CD) pipelines for data engineering workflows.
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
Required Skills and Qualifications:
  • Proven experience as a Data Engineer with a focus on cloud platforms (AWS, GCP, Azure).
  • Proficiency in SQL for querying and database management.
  • Strong Python programming skills for data manipulation and scripting.
  • Familiarity with big data tools like Spark, Hive, or DataProc.
  • Knowledge of data modeling, schema design, and data architecture principles.
  • Experience with version control systems (e.g., Git) and CI/CD tools.
  • Understanding of security and compliance standards for data handling.
  • Strong problem-solving and communication skills.

The ideal candidate has strong experience with cloud platforms, is proficient in SQL and Python, and can work collaboratively with cross-functional teams to ensure data integrity, scalability, and performance.

Our estimate for the salary range for this position is $1200000 - $1800000 per year.



  • Hyderabad, Telangana, India algoleap Full time

    We are seeking a highly skilled Data Engineer to design, develop and maintain scalable data pipelines using Snowflake, dbt, Snaplogic and ETL tools. With a strong ability to optimize SQL queries and a good working knowledge of Python, you will be an integral part of our team.About the RoleThis is a key role within our organization, requiring a highly...


  • Hyderabad, Telangana, India 3i infotech Ltd Full time

    Job SummaryWe are seeking an experienced Cloud Data Engineer to join our team at 3i Infotech Ltd. As a key member of our data engineering group, you will design and implement scalable data solutions using cloud-based platforms such as Azure, AWS, or Google Cloud.About the RoleThis is a unique opportunity to work with diverse data sources, including...


  • Hyderabad, Telangana, India RiDik Full time

    We are seeking a highly skilled Cloud Engineer to join our team at RiDiK, responsible for designing, implementing, and maintaining scalable cloud infrastructure on Google Cloud Platform (GCP).About the RoleThis is an excellent opportunity for a motivated and experienced DevOps Engineer to take on new challenges and contribute to the growth of our...


  • Hyderabad, Telangana, India INFEC Services Private Limited Full time

    About the Role:We are seeking a highly skilled Senior Data Pipeline Engineer to join our team at INFEC Services Private Limited. The ideal candidate will have extensive experience in designing, developing, and maintaining scalable data pipelines and ETL processes.Job Summary:This is a contract-to-hire opportunity for a Senior Data Pipeline Engineer to work...

  • Azure Data Engineer

    1 month ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    We are seeking a highly skilled Azure Data Engineer to join our team at Tata Consultancy Services. As an ideal candidate, you will have 4 to 13 years of experience in designing and implementing scalable and secure data processing pipelines using Azure services such as Azure Data Factory, Azure Databricks, and others.In this role, you will be responsible for...


  • Hyderabad, Telangana, India Hirein5 Full time

    Cloud Engineer - AWSHirein5 is hiring a Cloud Engineer to work on our AWS team. The successful candidate will design, deploy, and maintain scalable and reliable cloud solutions on AWS.About the Job:Design and implement scalable, secure, and highly available cloud architectures on AWS.Automate deployments and manage infrastructure using tools like...


  • Hyderabad, Telangana, India Space Inventive Full time

    About the JobWe are seeking an experienced Data Engineer to join our team at Space Inventive. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable data pipelines for ingestion, processing, and transformation of large datasets.You will work closely with our cross-functional teams to understand business...

  • Cloud Data Architect

    4 weeks ago


    Hyderabad, Telangana, India WaferWire Cloud Technologies Full time

    About the RoleAre you an experienced data engineer looking to take your skills to the next level? We are seeking a talented Azure Data Engineer to join our team at WaferWire Cloud Technologies. In this role, you will design and implement scalable and efficient data pipelines using Azure Data Factory, Pyspark notebooks, Spark SQL, and Python.About the JobThis...


  • Hyderabad, Telangana, India Oracle Full time

    **Job Title:** Senior Data Engineering Specialist**Location:** Remote (USA)We are a leading provider of enterprise software solutions, and we're looking for a talented Senior Data Engineering Specialist to join our team. As a key member of our data engineering team, you will play a critical role in designing, building, and maintaining our data pipelines.You...


  • Hyderabad, Telangana, India Response Informatics Full time

    About the Role: We are seeking an experienced Data Architect to lead the design and implementation of enterprise-scale Data Lakehouse architectures using Azure technologies. The ideal candidate will have 15+ years of experience in data engineering and architecture, with expertise in Azure Data Factory, Databricks, Delta Tables, Unity Catalogs, and GitHub...


  • Hyderabad, Telangana, India Space Inventive Full time

    About Space InventiveWe are a pioneering company specializing in driving businesses through transformative digital journeys, helping organizations transition into digitally mature entities.Job OverviewEstimated Salary: $120,000 - $180,000 per year. As a Data Engineer at Space Inventive, you will be responsible for designing and maintaining efficient data...


  • Hyderabad, Telangana, India Milestone Technologies, Inc. Full time

    About Milestone Technologies, Inc.We are a forward-thinking organization dedicated to harnessing the power of cutting-edge data processing technologies. Our team is passionate about evolving and deploying advanced data infrastructure to drive business growth and innovation.Job Summary$150,000 - $200,000 per yearWe are seeking an experienced Senior Cloud Data...


  • Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    Job DescriptionWe are seeking a skilled Data Engineer with expertise in AWS, Python, and PySpark to join our team at AppSierra Solutions Pvt Ltd. As a Data Engineer, you will be responsible for developing, testing, and maintaining scalable data pipelines and systems that meet the needs of our organization.Key Responsibilities:- Develop, test, and maintain...


  • Hyderabad, Telangana, India BizViz Technologies Pvt Ltd Full time

    Job OverviewBizViz Technologies Pvt Ltd is seeking an experienced Data Engineer to design, develop and maintain scalable data pipelines and workflows on Azure cloud services.Company OverviewWe are a dynamic technology company looking for talented professionals to join our team. As a Data Engineer at BizViz Technologies Pvt Ltd, you will play a key role in...


  • Hyderabad, Telangana, India Cloud Counselage Pvt Ltd Full time

    About the RoleCloud Counselage Pvt Ltd is seeking an experienced Senior Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesCollaborate with cross-functional teams to...

  • Cloud Data Architect

    3 weeks ago


    Hyderabad, Telangana, India Aeries Technology Group Full time

    **Job Description:Aeries Technology Group is a cutting-edge technology company that specializes in providing innovative data engineering solutions. We are seeking a highly skilled Cloud Data Architect to join our team and contribute to the design and implementation of our cloud-based data pipelines.About the Role:As a Cloud Data Architect, you will be...


  • Hyderabad, Telangana, India Value Creed Full time

    We are seeking a highly skilled Data Engineering Expert to join our team as a Cloud Solutions Specialist. The ideal candidate will have extensive experience in designing, implementing, and optimizing end-to-end data pipelines for cloud-based environments.As a Cloud Solutions Specialist, you will work closely with business stakeholders to understand their...


  • Hyderabad, Telangana, India Quess Corp Limited Full time

    Job Description:We are seeking a skilled Cloud Data Engineering Specialist to join our team at Quess Corp Limited.The ideal candidate will have 4-6 years of experience in designing, developing, and maintaining scalable data pipelines using SQL, PySpark, and Python.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain efficient data...

  • Cloud Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Genpact Full time

    As a Cloud Data Engineer at Genpact, you will be responsible for designing and building unified data platforms that cater to the evolving needs of our clients. With a strong focus on cloud-based solutions, you will lead the development of end-to-end architectures that drive business outcomes and create lasting value for our clients.About the RoleWe are...

  • Data Engineer

    1 month ago


    Hyderabad, Telangana, India CUPWINGS SYSTEMS PRIVATE LIMITED Full time

    Job Title: Data Engineer - Cloud Data ArchitectAbout Us: CUPWINGS SYSTEMS PRIVATE LIMITED is a leading technology company that aims to provide innovative solutions to its clients.Salary: ₹1,500,000 - ₹2,000,000 per annum (dependent on location and experience)Job Description:Data Engineering Role:CUPWINGS SYSTEMS PRIVATE LIMITED is seeking an experienced...