Big Data Engineer

9 hours ago

Gurugram, India Qcentrio Full time

Notice Period : Immediate - 30 days

Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud

JD and required Skills & Responsibilities :

  • Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.

  • Solve complex business problems by utilizing a disciplined development methodology.

  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.

  • Analyse the source and target system data. Map the transformation that meets the requirements.

  • Interact with the client and onsite coordinators during different phases of a project.

  • Design and implement product features in collaboration with business and Technology stakeholders.

  • Anticipate, identify, and solve issues concerning data management to improve data quality.

  • Clean, prepare, and optimize data at scale for ingestion and consumption.

  • Support the implementation of new data management projects and re-structure the current data architecture.

  • Implement automated workflows and routines using workflow scheduling tools.

  • Understand and use continuous integration, test-driven development, and production deployment frameworks.

  • Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.

  • Analyze and profile data for the purpose of designing scalable solutions.

  • Troubleshoot straightforward data issues and perform root cause analysis to proactively resolve product issues.

Required Skills :

  • 5+ years of relevant experience developing Data and analytic solutions.

  • Experience building data lake solutions leveraging one or more of the following AWS, EMR, S3, Hive & PySpark

  • Experience with relational SQL.

  • Experience with scripting languages such as Python.

  • Experience with source control tools such as GitHub and related dev process.

  • Experience with workflow scheduling tools such as Airflow.

  • In-depth knowledge of AWS Cloud (S3, EMR, Databricks)

  • Has a passion for data solutions.

  • Has a strong problem-solving and analytical mindset

  • Working experience in the design, Development, and test of data pipelines.

  • Experience working with Agile Teams.

  • Able to influence and communicate effectively, both verbally and in writing, with team members and business stakeholders

  • Able to quickly pick up new programming languages, technologies, and frameworks.

  • Bachelor's degree in computer science

  • Big Data Engineer

    8 hours ago

    Gurugram, India Insight Global Full time

    Pay Range:LPA (INR) Required Qualifications: 3–5 years of hands-on experience in Big Data engineering. Proficiency in Python (Java is a plus). Strong understanding of Google Cloud Platform (GCP) services and architecture. GCP certification is a plus. Solid problem-solving skills and a structured thought process. Experience with data migration and...

  • Big Data Tester

    8 hours ago

    Gurugram, India Kezan Inc Full time

    Job Title:Big Data Tester (SQL) Experience:3+Years Location:(Gurugram/Bangalore) Employment Type:Full-Time Job Summary: We are seeking a highly skilledBig Data Tester with strong SQL expertiseto join our team. The ideal candidate will be responsible for validating, testing, and ensuring the quality of large-scale data pipelines, data lakes, and big data...

  • Big Data Developer

    8 hours ago

    Gurugram, India Kezan Inc Full time

    Position: Big Data Engineer ( Immediate Joiner) Experience: 5+ Years Location: ( Gurugram / Bangalore ) Joining: Immediate Joiner Budget LPA Job Summary: We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal...

  • Senior Data Engineer

    3 days ago

    Gurugram, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Responsibilities :- You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS.- Responsibilities includes design and implementation of various Big Data platform components like (Batch Processing, Live Stream Processing, In- Memory Cache, Query Layer (SQL), Rule Engine and Action Framework ).- Design and...

  • Big Data Developer

    7 hours ago

    Gurugram, India Kezan Inc Full time

    Position: Big Data Engineer Experience: 5+ Years Location: ( Gurugram / Bangalore ) Joining: Immediate Joiner Budget=16.5 LPA Job Summary: We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have...

  • DevOps - Big Data

    2 weeks ago

    Gurugram, Haryana, India HoonarTek Full time

    Gurugram **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.- Using centuries of cumulative experience, research and...

  • Big Data Tester

    2 weeks ago

    Bengaluru, Gurugram, India Kezan Consulting Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    **ONLY FOR IMMEDIATE JOINERS**Position: Big Data TesterExperience: 4+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerJob Summary:We are seeking an experienced Big Data Tester with a strong background in HDFS, Hive, ETL testing, and SQL. The ideal candidate will have a experience in Big Data ecosystems, ETL/SQL testing, and in the...

  • Apps Associates

    3 days ago

    Gurugram, India Apps Associates (I) Pvt. Ltd Full time

    Job Description :Key Responsibilities : - Data Architecture & Strategy : Lead the design and implementation of scalable, reliable, and high performance data architectures, data lakes, and data warehouses.- ETL/ELT Pipeline Development : Architect, build, and optimize complex ETL/ELT pipelines to ingest, transform, and load data from diverse sources into...

  • Big Data Quality Assurance Engineer

    3 days ago

    Gurugram, India SK HR Consultants Full time

    Experience : 4 to 6 YearsJob location : Pune, Bangalore and GurgaonWhat You Need :- 4 to 6 years of QA experience with a strong focus on Big Data testing, particularly in Data Lake environments on Azure's cloud platform.- Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.-...

  • Big Data QA

    2 weeks ago

    Gurugram, Haryana, India HoonarTek Full time

    Gurugram, Pune **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.- Using centuries of cumulative experience, research...