Big Data Engineer

3 weeks ago

Gurugram, India Qcentrio Full time

Notice Period : Immediate - 30 days

Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud

JD and required Skills & Responsibilities :

  • Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.

  • Solve complex business problems by utilizing a disciplined development methodology.

  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.

  • Analyse the source and target system data. Map the transformation that meets the requirements.

  • Interact with the client and onsite coordinators during different phases of a project.

  • Design and implement product features in collaboration with business and Technology stakeholders.

  • Anticipate, identify, and solve issues concerning data management to improve data quality.

  • Clean, prepare, and optimize data at scale for ingestion and consumption.

  • Support the implementation of new data management projects and re-structure the current data architecture.

  • Implement automated workflows and routines using workflow scheduling tools.

  • Understand and use continuous integration, test-driven development, and production deployment frameworks.

  • Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.

  • Analyze and profile data for the purpose of designing scalable solutions.

  • Troubleshoot straightforward data issues and perform root cause analysis to proactively resolve product issues.

Required Skills :

  • 5+ years of relevant experience developing Data and analytic solutions.

  • Experience building data lake solutions leveraging one or more of the following AWS, EMR, S3, Hive & PySpark

  • Experience with relational SQL.

  • Experience with scripting languages such as Python.

  • Experience with source control tools such as GitHub and related dev process.

  • Experience with workflow scheduling tools such as Airflow.

  • In-depth knowledge of AWS Cloud (S3, EMR, Databricks)

  • Has a passion for data solutions.

  • Has a strong problem-solving and analytical mindset

  • Working experience in the design, Development, and test of data pipelines.

  • Experience working with Agile Teams.

  • Able to influence and communicate effectively, both verbally and in writing, with team members and business stakeholders

  • Able to quickly pick up new programming languages, technologies, and frameworks.

  • Bachelor's degree in computer science

  • Big Data Engineer

    3 weeks ago

    Gurugram, India Insight Global Full time

    Pay Range:LPA (INR) Required Qualifications: 3–5 years of hands-on experience in Big Data engineering. Proficiency in Python (Java is a plus). Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus. Solid problem-solving skills and a structured thought process. Experience with data migration and...

  • Big Data Tester

    3 weeks ago

    Gurugram, India Kezan Inc Full time

    Job Title:Big Data Tester (SQL) Experience:3+Years Location:(Gurugram/Bangalore) Employment Type:Full-Time Job Summary: We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Developer

    3 weeks ago

    Gurugram, India Kezan Inc Full time

    Position: Big Data Engineer ( Immediate Joiner) Experience: 5+ Years Location: ( Gurugram / Bangalore ) Joining: Immediate Joiner Budget LPA Job Summary: We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal...

  • Senior Big Data Software Engineer

    1 week ago

    Gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Senior Big Data Software Engineer

    1 week ago

    Gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Big Data Developer

    3 weeks ago

    Gurugram, India Kezan Inc Full time

    Position: Big Data Engineer Experience: 5+ Years Location: ( Gurugram / Bangalore ) Joining: Immediate Joiner Budget=16.5 LPA Job Summary: We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have...

  • DevOps - Big Data

    5 days ago

    Gurugram, Haryana, India HoonarTek Full time

    Gurugram **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.- Using centuries of cumulative experience, research and...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Responsibilities :- You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS.- Responsibilities includes design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In- Memory Cache, Query Layer (SQL), Rule Engine and Action Framework ).- Design and...

  • Big Data Testing Engineer

    7 days ago

    Bengaluru, Gurugram, India Techno Comp (TCI) Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Big Data Test Engineer with expertise in Big Data Testing, ETL, SQL, SSRS, and Manual Testing. The role involves working on both enhancements and production support activities, ensuring data quality, validating ETL workflows, and supporting reporting processes. You will collaborate with cross-functional teams including...

  • Senior Big Data Engineer

    1 week ago

    Gurugram, India FxConsulting Full time

    Position : Big Data EngineerExperience : 59 Years Job Type : Full-timeJob Summary :We are seeking a highly skilled Big Data Engineer with 59 years of experience to develop, maintain, and optimize robust, scalable big data solutions. This role requires expertise in designing and implementing solutions using Hadoop-based technologies and AWS. The engineer will...