Senior Big Data Engineer

1 month ago


Gurgaon, Haryana, India Arrixa Full time

Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.

About Arrixa

Arrixa is a leading provider of innovative software solutions, dedicated to helping businesses succeed in the digital age. Our team of experts is passionate about harnessing the power of technology to drive growth and improve customer experiences.

Job Description

We are looking for a highly skilled Senior Big Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and deploying big data solutions using Azure Databricks and other Azure data services. Your primary focus will be on building scalable and efficient data pipelines that meet the needs of our business stakeholders.

Key Responsibilities:
  • Design and implement big data solutions using Azure Databricks, Apache Spark, and other Azure data services.
  • Develop and optimize data pipelines for ETL/ELT processing, data transformation, and analytics.
  • Collaborate with data scientists and other stakeholders to integrate data science models into Databricks workflows.
  • Implement security best practices and ensure compliance with organizational regulations.
  • Develop and maintain CI/CD pipelines using Azure DevOps and automate deployment of infrastructure and Databricks jobs.
Requirements:
  • 3+ years of hands-on experience with Azure Databricks and big data technologies like Apache Spark.
  • Strong knowledge of Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and other Azure data services.
  • Proficiency in Python, Scala, or SQL for data processing and pipeline development.
  • Experience with Git and Agile/Scrum development methodologies.
  • Certifications such as Azure Data Engineer Associate or Azure Solutions Architect are a plus.
Salary: $120,000 - $180,000 per year

This salary range is based on industry standards and takes into account the complexity of the role, the required skills and qualifications, and the location. We offer a competitive compensation package that includes benefits, bonuses, and opportunities for professional growth and development.



  • Gurgaon, Haryana, India HUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED Full time

    Job Description: Senior Big Data Engineer LeadHUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED is a cutting-edge technology company that values innovation, collaboration, and excellence. Our team is passionate about leveraging data science to drive business growth and transform industries.About the Role:We are looking for a seasoned Senior Big Data Engineer...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....

  • Big Data Architect

    2 weeks ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...


  • Gurgaon, Haryana, India Max life insurance co ltd Full time

    Job Description: Max Life Insurance Co Ltd is seeking an experienced Senior Big Data Engineer to lead the development and maintenance of our big data infrastructure on the AWS cloud platform. In this role, you will be responsible for architecting, designing, and implementing scalable data pipelines and infrastructure that support data-driven decision-making...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...


  • Gurgaon, Haryana, India Rapture Staffing Full time

    Data Engineering PositionAbout the Role:We are seeking an experienced data engineer to develop and implement efficient data architectures and pipelines. The ideal candidate will have a strong background in ETL tools, big data technologies, and cloud platforms.Responsibilities:Design and implement data architectures and pipelines that meet business...

  • Big Data Specialist

    2 weeks ago


    Gurgaon, Haryana, India Aptita Consulting Partners Full time

    About Aptita Consulting PartnersWe are a leading consulting firm that specializes in delivering high-quality data engineering and analytics solutions to our clients. Our team of experts has a deep understanding of the latest technologies and trends in the field.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer,...


  • Gurgaon, Haryana, India IGT Full time

    About the RoleExciting opportunity for a seasoned data engineer to join IGT Solutions as a Senior Big Data Specialist. This role requires 3+ years of experience in designing, developing, and maintaining scalable data pipelines using Python and PySpark.Key Responsibilities:Design and develop efficient data pipelines using Python and PySpark.Work with SQL and...


  • Gurgaon, Haryana, India IGT Solutions Full time

    Job Title: Senior Big Data SpecialistWe are seeking a seasoned Senior Big Data Specialist with 6 years of experience in designing and implementing scalable data pipelines. The ideal candidate will have expertise in AWS Cloud services, including IAM, EC2, S3, Glue, Athena, Redshift, and CloudWatch.About the Role:The role involves working with programming...

  • Big Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India IGT Solutions Full time

    Data Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...


  • Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    About our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    About the RoleWe are seeking an experienced Senior Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets in our Bangalore, Chennai, Kolkata, Gurugram, Pune office.The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, proficient knowledge of distributed computing...

  • Data Architect

    3 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...


  • Gurgaon, Haryana, India AIDA projektai, MB Full time

    Job Description:We are seeking a highly skilled Senior Real-Time Data Engineer to join our team at AIDA projektai, MB. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying real-time data streaming pipelines.Key Responsibilities:Design, implement, and manage real-time data streaming...


  • Gurgaon, Haryana, India Steerlean Consulting Services Pvt Ltd. Full time

    Job Description: Steerlean Consulting Services Pvt Ltd. is seeking an experienced Sr. Big Data Developer to join our team. The successful candidate will design, build, and maintain scalable data pipelines and systems to support analytics and business intelligence.In this role, you will work closely with data scientists, analysts, and other engineers to...


  • Gurgaon, Haryana, India The Nielsen Company Full time

    Senior/Lead Software Engineer Position OverviewWe are seeking an experienced Senior/Lead Software Engineer to join our DevOps team at The Nielsen Company. In this role, you will be responsible for analyzing, developing, testing, and supporting Big Data applications.

  • Senior Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job OverviewSpectral Consultants is seeking an experienced Big Data Developer to join our team.About the RoleWe are looking for a skilled professional with expertise in building scalable and efficient data pipelines using Big Data technologies such as Hive, Spark, Hadoop, and MapReduce.Key ResponsibilitiesDesign, implement, and optimize large-scale data...


  • Gurgaon, Haryana, India Zupee Full time

    About UsZupee is India's fastest-growing innovator in real-money gaming, focusing on skill-based games on mobile platforms.We're a team of innovators and entrepreneurs driven by a passion for creating unique experiences that bring people together.Our MissionTo become the most trusted and responsible entertainment company in the world.Job DescriptionWe're...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...


  • Gurgaon, Haryana, India Publicis Sapient Full time

    Job SummaryWe are seeking a seasoned Senior Associate Data Engineer with expertise in cloud architecture and big data solutions to join our team. This is an exciting opportunity to leverage your technical skills and experience to design, implement, and maintain scalable data engineering solutions.About the RoleThe ideal candidate will have a strong...