Data Engineer

1 week ago

Any Location, India Blueridge Global Full time

Are you passionate about building state-of-the-art data platforms and powering the next generation of compute and AI applications, we'd love to hear from you. This is an exciting opportunity to leverage your expertise in distributed computing frameworks to make a significant impact as we push the boundaries of supply chain planning and eventually adoption of Gen AI.

JOB BRIEF :

We are seeking an experienced Data Engineer to join our team and lead the development of a cutting-edge data platform. The platform will leverage distributed computing frameworks such as Apache Spark, Databricks, and Snowflake to enable near real time supply chain planning, eventually leading to advanced analytics, insights into data with the adoption of Generative AI (GenAI) technologies across our product base.

KEY RESPONSIBILITIES :

As a Lead Data Engineer, the candidate would be responsible for :

- Design and build a highly scalable, fault-tolerant data platform optimized for distributed computing and large-scale data processing

- Implement data pipelines and ETL/ELT processes using distributed computing frameworks to efficiently ingest, transform, and load massive datasets from various sources

- Leverage cloud data platforms to enable seamless data sharing, near-zero maintenance, and fast analytics on structured and semi-structured data

- Collaborate with data scientists, machine learning engineers, and software developers to understand data requirements and build solutions to power GenAI applications

- Optimize distributed computing jobs and queries for maximum performance and cost efficiency

- Implement data governance, security, and compliance best practices

- Provide guidance on distributed computing architecture and mentor junior data engineers

QUALIFICATIONS :

- 5+ years of experience as a Data Engineer working with big data technologies.

- Strong proficiency in SQL, Python programming and data modeling techniques.

- Deep expertise in distributed computing principles and frameworks (e.g., Apache Spark), including SQL, streaming, and optimizing jobs for scale and efficiency.

- Hands-on experience with developing and deploying distributed computing applications using cloud-based platforms (e.g., AWS EMR, Azure HDInsight, or equivalent).

- Strong understanding of cloud data platform architectures and best practices for ELT/ETL, data sharing, and query optimization (e.g., AWS Athena, AWS Glue, Azure Synapse Analytics, or equivalent).

- Experience enabling application engineers to build applications leveraging the data platform through APIs and abstractions.

- Experience with orchestration frameworks like Apache Airflow and data streaming technologies like Kafka

- Experience building and optimizing data pipelines for machine learning applications.

- Knowledge of data modelling, data warehousing, and schema design.

- Familiarity with public cloud platforms such as AWS, Azure, or GCP.

- Excellent problem-solving and communication skills.


- Bachelor's or Master's degree in Computer Science (Preferred), Engineering, or a related field

(ref:hirist.tech)

  • Senior Network Engineer

    1 week ago

    Any Location, India Frontline Data Solutions Full time

    Who We Are :Frontline Data Solutions provides web-based (SaaS) environmental, health, and safety software to some of the world's leading chemical, oil & gas, and manufacturing companies. Frontline's work culture combines the fast-paced, entrepreneurial culture of a startup software company with the stability and professionalism that reflects our...

  • Senior Network Architect

    1 month ago

    Any Location, India Frontline Data Solutions Full time

    **Role Overview**Frontline Data Solutions is seeking a skilled Senior Network Engineer to join our DevOps team. As a critical member of our networking and infrastructure team, you will design and support the operational infrastructure for our products, including security, disaster recovery plans, and backup management.Key ResponsibilitiesDesign and implement...

  • Cloud Data Engineer

    1 week ago

    Any Location, India Techolution Full time

    Job OverviewWe are seeking a seasoned Cloud Data Engineer to join our team at Techolution, where we harness expertise in novel technologies to deliver innovative solutions for our enterprise clients. This role will involve designing and developing highly scalable data pipelines on Google Cloud Platform (GCP).About the RoleThis is an excellent opportunity for...

  • Big Data Engineering Specialist

    7 days ago

    Any Location, India Freelancer Recruiter Full time

    Job OverviewWe are seeking an experienced Big Data Engineer to join our team at Freelancer Recruiter. In this role, you will be responsible for managing the Big Data application stack including HDFS, YARN, Spark, Hive and HBase.About the RoleThis is a challenging position that requires a deep understanding of all configurations required for installing and...

  • Techolution - Associate Google Cloud Platform Data Engineer

    1 week ago

    Any Location, India Techolution Full time

    Job Description : We are looking for a Google Cloud Data Engineer who will help us build a highly scalable and reliable platform to match our exponential growth. As a Google Cloud Data Engineer, you will be responsible for building a solid back end infrastructure which will enable data delivery in near real-time using next-gen technologies.Title : Google...

  • Network Infrastructure Architect

    3 days ago

    Any Location, India Frontline Data Solutions Full time

    About Us">Frontline Data Solutions is a leading provider of web-based environmental, health, and safety software to prominent chemical, oil & gas, and manufacturing companies.We offer an autonomous and entrepreneurial work culture, where our 25-year history provides stability and professionalism. Our fast-paced environment fosters innovation, while our...

  • Data Scientist/Analyst

    1 month ago

    Any Location, India Yo HR Consultancy Full time

    Role : Data Scientist/AnalystExperience : 2 - 15 YearsLocation : Anywhere in the World - Permanent RemoteContract Duration : 6-12 monthsWork timings which is primarily, overlap is required from 8 AM to 1 PM PST. The remaining 3 hours can be accommodated either before 8 AM PST or after 1 PM PSTOpportunity : Full Time, 8 hours, 6 monthsMust-Have :-...

  • Enterprise Data Integration Specialist

    1 week ago

    Any Location, India Liveconnections Full time

    Job Title: Enterprise Data Integration Specialist About the Role:We are seeking a seasoned Ab Initio Developer with strong expertise in the Ab Initio suite and related technologies to join our team at Liveconnections. The ideal candidate will have deep experience in working with GDE components, metadata management, and advanced data processing. Key...

  • Data Scientist

    1 week ago

    Any Location, India Calyptus Full time

    Job Description : Roles and Responsibilities : - Lead and mentor a team of data scientists and NLP specialists. - Manage multiple NLP projects from conception to deployment. - Collaborate with product managers, engineers, and stakeholders to understand requirements and deliver solutions. - Ensure timely delivery of projects while maintaining high-quality...

  • Serial Plotter/Technical Data Analyst

    1 month ago

    Any Location, India 17 LIVE Full time

    Job Description : Love solving puzzles? Passionate about collecting clues and create magical story? Get goosebumps about uncovering deepest secret? We might have a role for you.Help us find insights hidden beneath loads of data. Use the most sophisticated tools in data analysis industry to dig the truth behind customer behaviour. Forge coherent stories to...

  • Engineering Manager

    1 month ago

    Any Location, India Insightsquared Full time

    Role Details : - Build vision and direction for the solutions delivery & implementations and POC's.- Participate in solution calls and build features needed for the market needs.- Oversee the execution of delivery, ensuring high-quality outcomes and client satisfaction.- Implement best practices for project management and delivery to streamline...

  • Big Data DevOps Engineer

    1 week ago

    Any Location, India Freelancer Recruiter Full time

    Job Requirements : - 5+ years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase- A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run- Experience setting up high availability, configuring resource allocation, setting up capacity...

  • Meditation.live - Director Of Engineering - System Architecture

    1 week ago

    Any Location, India Meditation.live Full time

    Job Description :- Wellness Coach is an all-encompassing digital wellness platform designed to inspire you to become the best version of yourself. Our Mission: - Inspire 5 billion people to be their best selves- - We are the only unique global platform where our users can share experiences and ask questions to expert coaches live. Because of this we are...

  • Hardware Design Verification Engineer

    1 month ago

    Any Location, India Yo HR Consultancy Full time

    Experience : 3 - 25 YearsLocation : Permanent RemoteContract Length : 6 MonthsOpportunity : Full Time, 8 hours, 4 hours Mandatory overlap with PSTMust-Have :- BS or MS degree in Electrical, Engineering, or related field.- 3 - 5 years of proven experience in hardware design development.- Expertise in HDLs such as Verilog, SystemVerilog, VHDL, and SystemC.-...

  • Senior Network Engineer

    1 month ago

    Any Location, India Talpro Full time

    Job Type : Full-timeJob Description :We are seeking a Senior Network Engineer to join our dynamic team. The Senior Network Engineer will play a crucial role in the management, optimization, and security of our WAN/LAN network infrastructure. This position requires in-depth knowledge of network protocols, security measures, and the ability to troubleshoot and...

  • Senior Software Engineer

    2 days ago

    Any Location, India PFF Analytics Private Limited Full time

    Every Player. Every Play. Every Game.Overview :PFF is transforming the sports performance analytics experience end-to-end, building products that help NFL & NCAA and soccer front offices, coaching staffs, media partners and digital subscribers evaluate player performance at an unmatched level. We are the leading sports data analytics company in American...

  • Software Engineer

    1 week ago

    Any Location, India PRINCETON SOFTWARE SERVICES PRIVATE LIMITED Full time

    Job Description :Salary : 17 to 20 LPA As a Tech Lead Software Engineer , you will play a pivotal role in delivering world-class software projects. Your responsibilities will encompass developing and maintaining complex applications and systems, engaging in activities across the entire software delivery lifecycle.Key Responsibilities And Key Activities :-...

  • Full Stack Engineer

    1 week ago

    Any Location, India Freelancer Recruiter Full time

    Job Requirements : - 3+ years of industry experience in a software engineering role, preferably building a SaaS product. You can demonstrate the significant impact that your work has had on the product and/or the team.- Deep knowledge of a high-level programming language (Such as Java, JavaScript, Go, Python, etc.) but it doesn't need to be a language...

  • Full Stack Engineer

    1 week ago

    Any Location, India CUTTING EDGE SEARCH Full time

    Location : Remote workCONTRACT : 6 monthsJob Description : We are looking for a Fullstack Engineer with a strong emphasis on backend development to join our expanding team. In this role, you will design, develop, and maintain high-performance software applications. Your skills in Python and JavaScript (JS) will be vital for creating scalable and dependable...

  • MLOps Engineer

    1 week ago

    Any Location, India HuMetis Technologies Inc. Full time

    Job Description : Skills : Must Have Skills :- AWS- Azure Cloud Platform- GCP- DevOps- Kubernetes- Docker- JenkinsResponsibilities : Model Deployment and Automation : - Develop and maintain automated pipelines for model deployment, monitoring, and scaling, ensuring efficient and robust integration into production systems.- Implement best practices for...