Data Engineering Expert for Large-Scale Data Environments

23 hours ago

Gurgaon, Haryana, India SoftwareONE Full time

At SoftwareONE, we offer a unique opportunity for highly motivated and skilled Senior Data Engineers to join our team. As a Senior Data Engineer with expertise in Databricks and Azure, you will be responsible for designing, developing, and maintaining our data lakehouse and pipelines.

We are seeking a talented professional with a strong background in data engineering, experience with Databricks, Azure Data Factory, and other Azure services, as well as a passion for working with large-scale data sets.

Key Responsibilities
  • Collaborate with the Product Owner, Business analyst, and other team members to understand requirements and design scalable data pipelines and architectures.
  • Build and maintain data ingestion, transformation, and storage processes using Databricks and Azure services.
  • Develop efficient ETL/ELT workflows to extract, transform, and load data from various sources into data lakes.
  • Design solutions and drive implementation for enhancing, improving, and securing Data Lakehouse.
  • Optimize and fine-tune data pipelines for performance, reliability, and scalability.
  • Implement data quality checks and monitoring to ensure data accuracy and integrity.
  • Work with data developers, engineers, and data analysts to provide them with the necessary data infrastructure and tools for analysis and reporting.

A competitive salary of $150,000 - $180,000 per year is offered to attract top talent in the field. We encourage experienced individuals who have taken an intentional career break and are now prepared to return to work to explore our SOAR program.

Required Skills and Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 4+ years of proven experience as a Data Engineer, with a focus on designing and building data pipelines.
  • Experience in working with big and complex data environments.
  • Certifications in Databricks or Azure services are a plus.
  • Experience with data streaming technologies such as Apache Kafka or Azure Event Hubs is a plus.
Benefits

SoftwareONE offers a dynamic and inclusive work environment that encourages creativity and innovation. Our company values autonomy, thinking outside the box, and work-life harmony. We believe that our people are our greatest asset and offer opportunities for professional growth and development.

We welcome applicants from all backgrounds and abilities to apply. If you require reasonable adjustments at any point during the recruitment process, please email us directly. We are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants and teammates without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity, or expression.

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Nexthire Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to design, develop, and optimize large-scale data processing pipelines using Databricks on Azure.Design and Development: Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure. Implement ETL processes to ingest and transform data...

  • AWS Cloud Engineer for Large-Scale Data Processing and Search

    4 weeks ago

    Gurgaon, Haryana, India Status Neo Full time

    Job Description: We are seeking a highly skilled AWS Cloud Engineer to join our team at Status Neo.Key Responsibilities:Design and implement large-scale data processing pipelines using PySpark and AWS services.Develop and maintain efficient API integrations with large-scale endpoints.Manage and optimize search indices using AWS OpenSearch APIs.Automate and...

  • SAP Expert Consultant for Large Scale Implementations

    7 days ago

    Gurgaon, Haryana, India SAP Full time

    Unlock Your Potential in a Dynamic SAP EnvironmentWe are seeking an experienced SAP consultant to join our team and help drive the success of our large-scale implementations. As a member of our Center of Expertise, you will have the opportunity to work on cutting-edge projects, collaborate with global teams, and develop your skills in a fast-paced...

  • Data Science Expert

    1 month ago

    Gurgaon, Haryana, India ZIGRAM Full time

    About the RoleZIGRAM is seeking a highly skilled Data Science Expert to join our team. As a key member of our data science team, you will be responsible for analyzing complex data sets, identifying trends, and developing data-driven solutions to drive business growth.Key ResponsibilitiesDesign and implement data analysis and machine learning models to drive...

  • Cloud Data Engineering Expert

    1 week ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Cloud Data Engineering ExpertAbout the RoleBayOne Solutions, a 12-year-old software consulting organization based in California, US, is seeking an experienced Cloud Data Engineering Expert to join our team. In this role, you will be responsible for designing, building, and maintaining large-scale data engineering systems on cloud platforms like...

  • Leading Java Expert for Large-Scale Application Design

    2 weeks ago

    Gurgaon, Haryana, India Dhani Full time

    About DhaniDhani is a leading company in the field of technology, dedicated to delivering innovative solutions that drive business growth.Job Title: Leading Java Expert for Large-Scale Application DesignSalary: $250,000 - $350,000 per annum, based on experience and qualifications.Job Description:We are seeking a highly skilled and experienced Java Architect...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Data Engineer - Cloud ExpertAbout the Role:We are seeking a talented Data Engineer with expertise in cloud technologies to join our team at BayOne Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms like Azure, AWS, and GCP.Key...

  • Senior Data Engineer

    4 days ago

    Gurgaon, Haryana, India Paddlelift Full time

    About PaddleliftWe are a leading technology company that empowers businesses to succeed in the digital age. Our team of experts is dedicated to delivering innovative solutions that drive growth and profitability.Salary:$120,000 - $180,000 per yearJob DescriptionWe are seeking a highly skilled Data Engineer - Cloud Expert to join our team. As a key member of...

  • Senior Data Engineering Expert

    3 weeks ago

    Gurgaon, Haryana, India Uncap Research Labs Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Uncap Research Labs. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data architectures to...

  • Data Architect

    4 weeks ago

    Gurgaon, Haryana, India Renous Consulting Full time

    Data Architect - Billing/Finance Domains ExpertWe are seeking an experienced Data Architect to join our team at Renous Consulting. As a Data Architect - Billing/Finance Domains Expert, you will play a key role in designing and consulting on end-to-end IT architectures/solutions/data across BSS domains, specifically in Billing/Finance for large-scale global...

  • Senior Data Engineer

    1 month ago

    Gurgaon, Haryana, India Acuity Knowledge Partners Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team at Acuity Knowledge Partners. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems using Python and Flask.Key Responsibilities:Design and implement data pipelines using Python and FlaskDevelop and...

  • Data Scientist

    3 weeks ago

    Gurgaon, Haryana, India biup Full time

    About BiUPBiUP is a pioneering company in the immersive and artificial intelligence technology landscape. With a strong founding team boasting over 100 years of combined experience, we deliver top-notch solutions to our clients. We are looking for a talented Data Scientist to join our dynamic team.The RoleWe are seeking a Data Scientist with expertise in...

  • Data Engineering Expert

    2 days ago

    Gurgaon, Haryana, India Arrixa Full time

    Job DescriptionWe are seeking a highly skilled Big Data Specialist to design, develop, and maintain robust data pipelines and engineering solutions.You will work with cutting-edge technologies like Snowflake, AWS, and Python to transform raw data into valuable insights.Data Pipeline DevelopmentDesign and implement efficient ETL/ELT pipelines to ingest,...

  • Data Engineering Manager

    1 month ago

    Gurgaon, Haryana, India Status Neo Full time

    Job Title: Data LeadAt Status Neo, we're seeking a highly skilled Data Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and engineering large-scale systems, leading the development and deployment of data integration and ETL solutions, and collaborating with cross-functional teams to drive business...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Admin Looks Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the implementation of large scale data platforms. The ideal candidate will have a strong background in data modeling and design, as well as hands-on experience with modern data stack tools such as Airflow, Terraform, and DBT.Key Responsibilities:Implement, develop,...

  • Data Engineering Expert

    7 days ago

    Gurgaon, Haryana, India Nexthire Full time

    Job Summary:We are seeking an experienced Data Engineering Expert to join our team as a Databricks and Azure Specialist. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing large-scale data processing pipelines using Databricks on Azure.About the Role:The successful candidate will be responsible...

  • Senior Data Engineering Lead

    1 month ago

    Gurgaon, Haryana, India RENOUS EXTENSERVE PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineering Lead**Job Summary:** We're seeking a highly experienced Senior Data Engineering Lead to join our engineering team in building and deploying large-scale data systems. The ideal candidate will have a strong technical background, including 8+ years of experience in designing and engineering large-scale systems, and at...

  • MongoDB Data Engineer Specialist

    3 weeks ago

    Gurgaon, Haryana, India MongoDB Full time

    Data Engineer Role at MongoDBMongoDB is a cutting-edge technology company that empowers innovators to create, transform, and disrupt industries by unleashing the power of software and data. As a Data Engineer, you will play a key role in building large-scale data-driven solutions to help drive MongoDB's growth as a product and as a company.You will work with...

  • Senior Staff Engineer

    1 month ago

    Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Staff EngineerJob Summary:We are seeking a highly skilled Senior Staff Engineer to join our team at Nagarro. As a Senior Staff Engineer, you will be responsible for designing and implementing large-scale data processing systems using Azure cloud services and Databricks.Responsibilities:Design and implement data processing systems using...

  • Data Engineer

    1 month ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at BayOne Solutions. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data warehouses and data lakes on cloud platforms like Azure, AWS,...