Big Data Engineer

16 hours ago

Gurgaon, Haryana, India Qcentrio Full time ₹ 15,00,000 - ₹ 28,00,000 per year

Notice Period : Immediate - 30 days

Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud

JD and required Skills & Responsibilities :

  • Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support.

  • Solve complex business problems by utilizing a disciplined development methodology.

  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.

  • Analyse the source and target system data. Map the transformation that meets the requirements.

  • Interact with the client and onsite coordinators during different phases of a project.

  • Design and implement product features in collaboration with business and Technology stakeholders.

  • Anticipate, identify, and solve issues concerning data management to improve data quality.

  • Clean, prepare, and optimize data at scale for ingestion and consumption.

  • Support the implementation of new data management projects and re-structure the current data architecture.

  • Implement automated workflows and routines using workflow scheduling tools.

  • Understand and use continuous integration, test-driven development, and production deployment frameworks.

  • Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.

  • Analyze and profile data for the purpose of designing scalable solutions.

  • Troubleshoot straightforward data issues and perform root cause analysis to proactively resolve product issues.

Required Skills :

  • 5+ years of relevant experience developing Data and analytic solutions.

  • Experience building data lake solutions leveraging one or more of the following AWS, EMR, S3, Hive & PySpark

  • Experience with relational SQL.

  • Experience with scripting languages such as Python.

  • Experience with source control tools such as GitHub and related dev process.

  • Experience with workflow scheduling tools such as Airflow.

  • In-depth knowledge of AWS Cloud (S3, EMR, Databricks)

  • Has a passion for data solutions.

  • Has a strong problem-solving and analytical mindset

  • Working experience in the design, Development, and test of data pipelines.

  • Experience working with Agile Teams.

  • Able to influence and communicate effectively, both verbally and in writing, with team members and business stakeholders

  • Able to quickly pick up new programming languages, technologies, and frameworks.

  • Bachelor's degree in computer science

  • GCP Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Big Data Developer

    10 hours ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • Big Data Engineer

    10 hours ago

    Gurgaon, Haryana, India MyCareernet Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company:Indian / Global Digital OrganizationKey Skills:Pyspark, AWS, Python, SCALA, ETLRoles and Responsibilities:Develop and deploy ETL and data warehousing solutions using Python libraries and Linux bash scripts on AWS EC2, with data stored in Redshift.Collaborate with product and analytics teams to scope business needs, design metrics, and build...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Engineer - Data Management / Big Data

    8 hours ago

    Gurgaon, Haryana, India American Express Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Big Data Automation QA

    12 hours ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...

  • Data Engineer

    6 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Senior Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 8,00,000 - ₹ 13,00,000 per year

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...

  • Senior Big Data Engineer

    6 days ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...