Big Data Engineer

2 weeks ago

Bengaluru Chennai Hyderabad, India Artech Full time US$ 9,00,000 - US$ 12,00,000 per year

Job Title: Data Engineer (Python, PySpark, PL/SQL)

Work Location: Chennai, Tamil Nadu

Experience Required: 4 to 6 Years

Job Description:

We are seeking a skilled and motivated Data Engineer with 4-6 years of experience to join our team in Chennai. The ideal candidate will have hands-on experience with Python, PySpark, and PL/SQL, along with a strong understanding of Big Data technologies and cloud-based data platforms, especially Google Cloud Platform (GCP).

Key Responsibilities:

  • Design, develop, and optimize data pipelines using Python and PySpark.
  • Write efficient SQL and PL/SQL queries for data extraction, transformation, and analysis.
  • Work with GCP services, particularly BigQuery, for data warehousing and processing tasks.
  • Collaborate with data analysts, engineers, and other stakeholders to understand data requirements and deliver scalable solutions.
  • Ensure data quality, consistency, and governance across the pipeline.
  • Troubleshoot data issues and optimize performance of data workflows.

Essential Skills:

  • Proficiency in Python and PySpark for data engineering and ETL processes.
  • Strong expertise in PL/SQL and SQL query optimization.
  • Hands-on experience with Google Cloud Platform (GCP), especially BigQuery.
  • Knowledge of Big Data concepts and tools.
  • Ability to work in a collaborative and fast-paced environment.

Preferred Skills:

  • Experience with data orchestration tools such as Apache Airflow.
  • Familiarity with CI/CD practices and version control systems like Git.
  • Understanding of data modeling and data warehousing principles.

  • Big Data Engineer

    2 weeks ago

    Chennai, Hyderabad, India Orcanexgen Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    BigData EngineerHyderabad, ChennaiHybrid mode5+ years of experienceJob Description:Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques. Candidate will possess experience in developing highly scalable Big Data pipelines, strong technical knowledge, thought leadership, and a passion for creating...

  • Big Data Engineer

    2 weeks ago

    Chennai, Hyderabad, India Trustklub Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Roles and Responsibilities :Design, develop, and maintain large-scale data pipelines using PySpark on AWS cloud platform.Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions that meet business needs.Develop scalable data processing applications using Python programming language and integrate them with existing...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    7 days ago

    Chennai, Bengaluru / Bangalore, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job OverviewWe are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement big data solutions using Hadoop and Spark technologies.Work with cross-functional teams to understand business...

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Impacteers Full time

    Position Overview :We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence. The ideal candidate will...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Chennai, Pune, India Brillio Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves working closely with cross-functional teams to ensure the reliability,...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...