AWS Cloud Data Pipeline Specialist

2 days ago


Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Overview:

A Data Engineer at a top organization designs and develops scalable data pipelines using AWS services like Glue, S3, and Redshift. This role requires a strong understanding of Python, PySpark, and SQL to build robust ETL processes.

Key Responsibilities
  • Design and implement data pipelines using PySpark, focusing on performance, scalability, and data quality
  • Develop and maintain applications using Python and PySpark for data manipulation, transformation, and analysis
  • Lead and manage projects, including planning, execution, testing, and documentation
  • Translate business requirements into technical solutions using AWS cloud services and Python/PySpark

Requirements:

  • 5+ years working experience in data integration and pipeline development
  • Strong real-life experience in python development especially in PySpark in AWS Cloud environment
  • Excellent written and verbal communication skills to collaborate with team members and stakeholders

Preferred Skills:

  • Snowflake

We are looking for a skilled Data Engineer who can help us build efficient data pipelines. If you have experience with AWS services and PySpark, we want to hear from you


  • AWS Cloud Data Expert

    23 hours ago


    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a seasoned Data Engineer, you will be instrumental in designing and implementing data pipelines that drive business insights and inform key decision-making. You will work closely with cross-functional teams to develop scalable data architectures, leveraging cloud-based technologies like AWS.The ideal candidate will possess a strong foundation in data...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Freelance Data Engineer OpportunityJoin a collaborative environment where you can utilize your expertise in designing and optimizing large-scale data pipelines.Role OverviewAs an experienced Freelance Data Engineer, you will work closely with internal teams to design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks. The ideal...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Cloud Data EngineerWe are seeking a skilled and motivated cloud data engineer to join our team.The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage. They will also have experience in architecting and managing scalable BigQuery data...


  • Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering RoleJob OverviewThis is a key role within our organization, focusing on designing and developing data pipelines to ingest data from various sources into our data warehouse. The ideal candidate will have experience with AWS services such as Lambda, DMS, and Glue for data ingestion and transformation processes.Key ResponsibilitiesDesign and...


  • Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a seasoned Data Engineer to architect, deploy and maintain scalable data pipelines using cloud-based technologies like GCP, AWS or Azure.This is an exciting chance to work on cutting-edge data infrastructure with real-world impact, ensuring data reliability, quality and availability to support business needs.Design, develop and...


  • Dombivli, Maharashtra, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, DevOPs(CI-CD) Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Role:AWS Data EngineerWe are seeking an experienced professional to develop, maintain and optimize scalable data pipelines in the cloud. The ideal candidate will have hands-on expertise with AWS services including EMR, Glue, and PySpark.Key Responsibilities:Design and implement data pipelines using AWS services.Maintain and optimize existing ETL...


  • Dombivli, Maharashtra, India beBeeCloudEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Engineering ProfessionalSkillful and experienced cloud engineers are sought after to lead the design, build, and maintenance of AWS Cloud Infrastructure.AWS Cloud Services: Proficient in a wide range of AWS services including EC2, S3, RDS, VPC, Redshift, ECS, Route 53, Load Balancers, Auto Scaling, Cost Explorer, and more.ECS/EKS Clusters: Skilled in...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Title: Senior AWS Data EngineerWe are seeking a highly skilled and experienced Senior AWS Data Engineer to join our team.About the Role:This is a remote position that requires the ability to work independently and collaboratively as part of a team.Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using...