Big Data Developer

4 weeks ago

Noida, Uttar Pradesh, India Rudraksha Full time

Position : Big Data Engineer

Location : Noida & Hyderabad (onsite)

Type : Full Time

Experience : 8 + Years

Key Responsibilities :


- Design, develop, and maintain scalable data pipelines using AWS Glue, Lambda, and EMR.

- Implement robust ETL processes for data ingestion, transformation, and analysis from diverse data sources.

- Work with Snowflake or Redshift to model, store, and query large datasets efficiently.

- Optimize and write advanced SQL queries to support complex business use cases and reporting needs.

- Ensure data quality, reliability, and performance across systems and workflows.

- Collaborate with data scientists, analysts, and product teams to deliver data-driven solutions.

- Monitor data pipelines and implement error-handling, logging, and alerting mechanisms.

- Continuously improve data infrastructure by identifying bottlenecks and proposing solutions.

Required Skills & Qualifications :


- 5 + years of experience in Big Data engineering or a similar role.

- Proven experience with AWS Glue, Lambda, and EMR must-have.

- Hands-on experience with either Snowflake or Amazon Redshift.

- Strong knowledge of data pipeline design, data transformation, and data analysis best practices.

- Expert in SQL able to write and optimize complex queries, stored procedures, and analytical functions.

- Experience with scripting in Python, PySpark, or similar languages for ETL/ELT tasks.

- Familiarity with version control tools (e.g., Git) and CI/CD practices.

- Strong problem-solving skills and attention to detail.

- Excellent communication and collaboration skills.

(ref:hirist.tech)

  • Big Data Infrastructure Engineer

    4 days ago

    Noida, Uttar Pradesh, India beBeeDataPlatform Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Platform EngineerAbout the RoleThis position involves designing, developing and maintaining large-scale big data pipelines. The role requires strong technical skills, particularly in Scala and Java applications.The ideal candidate will have experience with containerization technology (Docker), cloud-native platforms, and big data technologies...

  • Azure & Big Data - Lead

    2 hours ago

    Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Data Scientist

    2 hours ago

    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data Scientist- Design, build, and maintain robust and scalable applications using Python and advanced AI frameworks.- Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel.- Integrate AI models and agentic systems with our existing data pipelines, APIs, and...

  • Data Scientist

    1 day ago

    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data ScientistDesign, build, and maintain robust and scalable applications using Python and advanced AI frameworks.Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel.Integrate AI models and agentic systems with our existing data pipelines, APIs, and...

  • Data Scientist

    5 days ago

    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data ScientistDesign, build, and maintain robust and scalable applications using Python and advanced AI frameworks.Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel.Integrate AI models and agentic systems with our existing data pipelines, APIs, and...

  • Data Scientist

    5 days ago

    Noida, Uttar Pradesh, India BIG Language Solutions Full time

    Job Description – Data Scientist Design, build, and maintain robust and scalable applications using Python and advanced AI frameworks. Develop complex, multi-step workflows and autonomous systems using LLM Orchestrators like LangChain, LlamaIndex, or Semantic Kernel. Integrate AI models and agentic systems with our existing data pipelines, APIs, and...

  • Big Data Developer

    2 weeks ago

    Noida, Uttar Pradesh, India Impetus Full time

    Immediate Joiners PreferredLocation : Indore, Noida, Gurugram, Hyderabad, Bangalore, Pune2-4 Years of experienceExpertize and hands-on experience on Python – Must HaveExpertize knowledge on SparkSQL– Must HaveGood knowledge of atleast one Cloud(AWS/Azure/GCP)- Must HaveGood knowledge of SQL – Good to HaveGood knowledge of Shell script – Good to...

  • Big Data Developer

    4 weeks ago

    Noida, Uttar Pradesh, India Impetus Full time

    Immediate Joiners PreferredLocation : Indore, Noida, Gurugram, Hyderabad, Bangalore, Pune 2-4 Years of experienceExpertize and hands-on experience on Python – Must HaveExpertize knowledge on SparkSQL– Must HaveGood knowledge of atleast one Cloud(AWS/Azure/GCP)- Must HaveGood knowledge of SQL – Good to HaveGood knowledge of Shell script – Good to...

  • Big Data Developer

    4 weeks ago

    Noida, Uttar Pradesh, India Impetus Full time

    Immediate Joiners Preferred Location : Indore, Noida, Gurugram, Hyderabad, Bangalore, Pune 2-4 Years of experience Expertize and hands-on experience on Python – Must Have Expertize knowledge on SparkSQL– Must Have Good knowledge of atleast one Cloud(AWS/Azure/GCP)- Must Have Good knowledge of SQL – Good to Have Good knowledge of Shell script – Good...

  • Big Data Developer

    2 weeks ago

    Noida, Uttar Pradesh, India Impetus Full time

    Immediate Joiners PreferredLocation : Indore, Noida, Gurugram, Hyderabad, Bangalore, Pune 2-4 Years of experienceExpertize and hands-on experience on Python – Must HaveExpertize knowledge on SparkSQL– Must HaveGood knowledge of atleast one Cloud(AWS/Azure/GCP)- Must HaveGood knowledge of SQL – Good to HaveGood knowledge of Shell script – Good to...