Data Engineer

15 hours ago

bangalore, India People Prime Worldwide Full time

Job Title: Senior Data Engineer - GCP + PythonLocation: HyderabadYears of Experience: 5+YearsAbout the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Job Overview:We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.Key Responsibilities:Design, develop, test, and maintain scalable ETL data pipelines using Python.Work extensively on Google Cloud Platform (GCP) services such as:Dataflow for real-time and batch data processingCloud Functions for lightweight serverless computeBigQuery for data warehousing and analyticsCloud Composer for orchestration of data workflows (based on Apache Airflow)Google Cloud Storage (GCS) for managing data at scaleIAM for access control and securityCloud Run for containerized applicationsShould have experience in the following areas :API framework: Python FastAPIProcessing engine: Apache SparkMessaging and streaming data processing : KafkaStorage: MongoDB, Redis/BigtableOrchestration: AirflowPerform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.Implement and enforce data quality checks, validation rules, and monitoring.Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.Document pipeline designs, data flow diagrams, and operational support procedures.Required Skills:5–10 years of hands-on experience in Python for backend or data engineering projects.Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).Solid understanding of data pipeline architecture, data integration, and transformation techniques.Experience in working with version control systems like GitHub and knowledge of CI/CD practices.Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).Experience in data migrations from on-premise data sources to Cloud platforms.

  • Senior Data Engineer

    4 days ago

    bangalore, India NTT DATA Full time

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Data Engineering

    9 hours ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 345813 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineering Analytics Architect to join our team in Bangalore Karn taka IN-KA India IN Role Own the strategy governance...

  • Enterprise Data Architect

    15 hours ago

    bangalore, India Aptus Data Labs Full time

    Enterprise Data Architect – Job DescriptionLocation: Bangalore (Hybrid)Experience: 15+ years in Data Engineering & Data PlatformsEmployment Type: Full-time About Aptus Data LabsAptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise across...

  • Enterprise Data Architect

    9 hours ago

    bangalore, India Aptus Data Labs Full time

    Enterprise Data Architect – Job DescriptionLocation: Bangalore (Hybrid)Experience: 15+ years in Data Engineering & Data PlatformsEmployment Type: Full-time About Aptus Data LabsAptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise across...

  • Enterprise Data Architect

    2 weeks ago

    bangalore, India Aptus Data Labs Full time

    Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Fid Federal Risk Applications Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341952 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Fid Federal Risk Applications Data Engineer

    7 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341951 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Senior Data Scientist

    2 weeks ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior DevOps Engineer

    1 week ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    7 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...