Data Engineer

22 hours ago

Bangalore, India Impetus Full time

Open Location - Gurgaon and Bangalore

Job Description

  • 4-7 years' experience working on Data engineering & ETL/ELT processes, data warehousing, and data lake implementation with Cloud services
  • Hands on experience in designing and implementing solutions like creating/deploying jobs, Orchestrating the job/pipeline and infrastructure configurations
  • Expertise in designing and implementing pySpark and Spark SQL based solutions
  • Design and implement data warehouses using Amazon Redshift, ensuring optimal performance and cost efficiency.
  • Good understanding of security, compliance, and governance standards.

Roles & Responsibilities

  • Design and implement robust and scalable data pipelines using GCP/AWS/Azure services
  • Drive architectural decisions for data solutions on Cloud platform, ensuring scalability, security, and cost-effectiveness.
  • Hands-on experience of Develop and deploy ETL/ELT processes using Glue/Azure data factory, Lambda/Azure functions, Step function/Azure logic apps/MWAA, S3 and Lake formation from various data sources.
  • Strong Proficiency in pySpark, SQL, Python.
  • Proficiency in SQL for data querying and manipulation.
  • Experience with data modelling, ETL processes, and data warehousing concepts.
  • Create and maintain documentation for data pipelines, processes, and following best practices.
  • Knowledge of various Spark Optimization technique, Monitoring and Automation would be a plus.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Understanding of data governance, compliance, and security best practices.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills – with understanding on stakeholder mapping

Mandatory Skills - AWS, GCP OR Azure Cloud, Python Programming, SQL, Spark SQL, Hive, Spark optimization techniques and Pyspark.

Share resume at with details (CTC, Expected CTC, Notice Period)

  • Data Engineer

    3 hours ago

    bangalore, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    22 hours ago

    Bangalore, India Synechron Full time

    Good-day, We have immediate opportunity for Data Engineer. Job Role: Data Engineer Job Location: Synechron ( Bengaluru) Experience- 7 to 12 years Notice : Only immediate joiner . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    2 hours ago

    bangalore, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer.Job Role: Data EngineerJob Location: Synechron ( Bengaluru)Experience- 7 to 12 yearsNotice : Only immediate joiner .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Data Engineer

    22 hours ago

    Bangalore, India Alp Consulting Ltd. Full time

    Role: Data Engineer Location : Bangalore Experience: 3 to 8Years SKILLS & CERTIFICATIONS Strong interest and acumen for solving large-scale data engineering problems. Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environments Strong hands-on expertise in data...

  • Data Engineer

    33 minutes ago

    bangalore, India Alp Consulting Ltd. Full time

    Role: Data EngineerLocation : BangaloreExperience: 3 to 8YearsSKILLS & CERTIFICATIONSStrong interest and acumen for solving large-scale data engineering problems.Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environmentsStrong hands-on expertise in data engineering:Enterprise grade ETL...

  • Data Engineer

    4 hours ago

    bangalore, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Data Engineer

    22 hours ago

    Bangalore, India Recro Full time

    Role - Data Engineer Location - Bangalore Experience - 2-4 Yrs Key Responsibilities Design, build, and optimize scalable data pipelines for batch and real-time data processing. Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources. Manage and optimize data storage solutions (data warehouses,...

  • Data Engineer

    2 hours ago

    bangalore, India Recro Full time

    Role - Data EngineerLocation - BangaloreExperience - 2-4 YrsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines for batch and real-time data processing.Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from multiple sources.Manage and optimize data storage solutions (data warehouses, data lakes, relational...

  • Data Engineer

    2 hours ago

    bangalore, India VAANTECH Full time

    We’re Hiring: Data EngineerPosition: Data EngineerExperience Required: 3+ YearsNotice Period: Immediate Joiner (or within 15 days)Location: Chennai (Remote)Shift: Includes Night Shifts (US Shift)Preferred Candidates: From Chennai, Andhra Pradesh, Kerala & BangaloreSkills We’re Looking For:SQL, Python, ETLApache AirflowData Pipeline Optimization &...

  • Data Engineer

    2 hours ago

    bangalore, India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)ExperienceMinimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)Proven experience in Python, Spark, and PySpark...