Data Engineer

2 weeks ago

Ajmer, India People Prime Worldwide Full time

About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in banking, healthcare, telecom, and media. Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation. The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, and North America and is backed by Baring Private Equity Asia. Job Title: AWS Data Engineer Key Skills: Required skills (maximum of 6): Pyspark, airflow, AWS S3, EKS, CICD, SQL, Shell script Job Locations: Bangalore Experience: 5 – 7 Years Budget: - 13LPA Education Qualification: Any Graduation Job Description: Key Responsibilities - Design, develop, and optimize ETL/ELT data pipelines using PySpark and Airflow. - Build scalable data ingestion and processing workflows on AWS (S3, Glue, EMR, Lambda, EKS, IAM). - Implement containerized data processing jobs on Amazon EKS and manage Kubernetes deployments. - Develop and maintain CI/CD pipelines to support automated deployment of data workflows. - Optimize performance of distributed data processing systems (Spark jobs, SQL queries, cluster tuning). - Write efficient SQL queries for transformations, analytics, and data validation. - Automate workflows using Shell scripting and Infrastructure-as-Code (IaC) tools. - Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions. - Ensure data integrity, security, and compliance with best practices and company standards. - Monitor, troubleshoot, and improve data pipelines and cloud resources. Required Skills & Qualifications - Strong hands-on experience with PySpark for large-scale data processing. - Solid experience with Apache Airflow for orchestration and workflow management. - Expertise in AWS cloud services including: - S3, Glue, Lambda, IAM, EMR, EKS, CloudWatch, KMS - Proficiency with SQL (query optimization, analytical queries). - Strong Shell scripting experience for automation. - Experience working with CI/CD pipelines (GitLab CI, GitHub Actions, CodePipeline, or similar). - Understanding of distributed systems, data modeling, and big data concepts. - Experience with Docker and Kubernetes (EKS preferred). - Familiarity with version control (Git) and DevOps best practices. Interested Candidates please share your CV to vamsi.v@people-prime.com

  • Data Engineer

    2 weeks ago

    ajmer, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....

  • Data Engineer

    1 week ago

    Ajmer, India Ignisov Consulting Services Full time

    Role: Data Engineer – HR Data ConversionJob Type: ContractJob Location: RemoteExperience: 5–10 yearsJob Description:Key Responsibilities:Develop and maintain ETL pipelines using Python and AirflowWork with SQL, GCP BigQuery, and cloud-based data workflowsBuild scalable solutions using Spark, Hive, HDFSDesign and optimize data models for HR data...

  • Data Engineer

    1 week ago

    Ajmer, India Ignisov Consulting Services Full time

    Role: Data Engineer – HR Data ConversionJob Type: ContractJob Location: RemoteExperience: 5–10 yearsJob Description:Key Responsibilities:Develop and maintain ETL pipelines using Python and AirflowWork with SQL, GCP BigQuery, and cloud-based data workflowsBuild scalable solutions using Spark, Hive, HDFSDesign and optimize data models for HR data...

  • Senior data engineer

    4 weeks ago

    Ajmer, India Tata Consultancy Services Full time

    Role**: Senior Data Engineer Required Technical Skill Set: Senior Data Engineer Desired Experience Range: 7 - 12 yrs Notice Period: Immediate to 90 Days only Location of Requirement: Bangalore We are currently planning to do a Virtual Interview Job Description: Primary Skills (Java, Python, etc.) Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks,...

  • Cloud Data Engineer

    4 days ago

    ajmer, India beBeeAzure Full time

    Cloud Data Engineer OpportunityWe are seeking an experienced Cloud Data Engineer with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.Strong knowledge and hands-on experience in Microsoft Azure (Data Factory, Storage, Synapse, Key Vault, etc.)Proficiency in Databricks: cluster management, job...

  • Chief Data Engineer

    7 days ago

    ajmer, India beBeeDataEngineer Full time

    Data Engineering Solutions Architect The role involves architecting data engineering solutions focusing on graph databases and data lakes.Key responsibilities include ETL process design, leveraging cloud-native technologies, utilizing LLMs for data extraction and transformation, and search products like Elastic Search/Solr/Algolia for complex experiences.

  • Senior Data Engineer

    3 weeks ago

    Ajmer, India Talentoj Full time

    Experience: 5–8 Years Location: [Open Location] | Type: Full-TimeJob SummaryWe are looking for a highly experienced Senior Data Engineer with strong expertise in Python, Advanced SQL, Snowflake, Amazon Redshift, Databricks, and Tableau. The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and...

  • Senior Data Engineer

    3 weeks ago

    Ajmer, India Talentoj Full time

    Experience: 5–8 Years Location: [Open Location] | Type: Full-TimeJob SummaryWe are looking for a highly experienced Senior Data Engineer with strong expertise in Python, Advanced SQL, Snowflake, Amazon Redshift, Databricks, and Tableau. The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and...

  • Data Engineering Professional

    2 weeks ago

    ajmer, India beBeeDataEngineering Full time

    Job SummaryWe are seeking a skilled Data Engineer to develop and maintain robust ETL pipelines for various data sources, utilizing Lakehouse architecture to manage structured and unstructured data.The ideal candidate will have strong expertise in SQL (PostgreSQL preferred) and Python, with hands-on experience in building ETL pipelines and exposure to modern...

  • Data Architect and Engineer

    2 weeks ago

    ajmer, India beBeeDataScientist Full time

    Data Scientist and EngineerWe are seeking a highly skilled Data Scientist and Engineer to join our team.Develop and optimize complex data pipelines using Python, PySpark, and AWS services (Glue, Lambda).Design and implement scalable data architectures for structured and unstructured data sources.Collaborate with cross-functional teams to deliver high-quality...