Data Engineer

1 week ago


Remote, India Fractal31 Pvt Ltd Full time

Roles and Responsibilities :

Cloud Migration : Manage the migration of legacy data workloads to modern cloud platforms, ensuring data quality, security, and optimal performance.

Data Science Support : Build client data pipelines from diverse sources to support data science applications, collaborating closely with data scientists to address data requirements.

Platform Standards : Establish and uphold standards for data platform maintainability, testability, performance, security, and usability. Drive consistency with reusable components and coding practices.

Code Conversion : Translate SAS-based pipelines into PySpark or Scala to execute on Hadoop and other Optimization : Enhance the performance of Big Data applications on both Hadoop and non-Hadoop platforms.

IT & Business Integration : Analyze and assess evolving business requirements to recommend and implement systems enhancements. Maintain a comprehensive understanding of data analytics as it supports business objectives.

Data Issue Resolution : Conduct detailed analyses of data issues, make actionable recommendations, and implement solutions.

Technical Skills :

Primary Skills : Strong expertise in PySpark and SQL, with a foundational understanding of data warehousing principles. Proficiency in Linux (Unix shell scripting) is Expertise : In-depth understanding of the Hadoop ecosystem and Big Data technologie, including HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, and Solr.

Programming Skills : Proficiency in Spark programming with PySpark, Python, or Scala for effective data processing and pipeline creation.

Development Experience :

- Demonstrated experience in end-to-end development of data pipelines, with a focus on hands-on involvement in construction; production support experience alone is not sufficient.

Data Management :

- Experience managing large data volumes, to effectively support data scale requirements.

- SQL & Database Proficiency: Advanced SQL skills for querying, analyzing, and working with complex, real-world datasets.

- Cloud Platform Familiarity: Experience with AWS or Azure is beneficial, though not essential.

Note : Cloud knowledge should complement core data engineering skills.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Remote, India Uncap Research Labs Full time

    Job Description : The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...

  • Data Engineer

    4 weeks ago


    Remote, India FANISKO PRIVATE LIMITED Full time

    Job Title : Data Engineer with AIML Expertise Years of Experience : 3+ years Qualifications : Any UG/PG Location : Remote Employment Type : Contract / Full-Time Employment (FTE) Required by Date : Immediate start Share your profiles to Job Description : - Data Pipeline Development : Design, implement, and maintain scalable and efficient data pipelines for...

  • Data Engineer

    2 weeks ago


    Remote, India Yo HR Consultancy Full time

    Title: Data Engineer (Technical Lead)Experience : 8 years to 14 yearsWork Mode: Remote Job Description : As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt ,...

  • Data Engineer

    3 weeks ago


    Remote, India Innovistors Technological Solutions Pvt Ltd Full time

    As a Data Engineer you'll be :- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture- Mentoring Fother Junior Engineers in the Team- Be a "go-to" expert for data technologies and...

  • Azure Data Engineer

    4 weeks ago


    Remote, India Infiniti Research Full time

    About Quantzig :Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...


  • Remote, India Leewayhertz Full time

    We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 5 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive individual who can...


  • Remote, India Staffbees Full time

    We are seeking the Data Engineer Panelist @ 10+ years of ExperienceThis Is a Freelance_WFH/Remote_USA Shift OpportunityMust have atleast 8+ Years of exp at any one One cloud Tech @ GCP, AZure or AWSShould have excellent knowledge @ Hadoop, python/pyspark, Bigdata,SQL & ETLRole Overview :We are seeking a highly experienced Data Engineer to serve as a panelist...

  • Senior Data Engineer

    2 weeks ago


    Remote, India Hunastreet Technology Pvt Ltd Full time

    Qualifications :- Bachelor's degree in Engineering, Computer Science, or relevant field.- 10+ years of experience in a Data Engineer role.- 3+ years experience with Apache Spark and solid understanding of the fundamentals.- Deep understanding of Big Data concepts and distributed systems.- Strong coding skills with Scala, Python, Java and/or other languages...


  • Remote, India Leewayhertz Full time

    As a key member of the Leewayhertz team, you will play a pivotal role in designing and implementing scalable data systems that drive business success. We are seeking an experienced Senior Data Engineer with a passion for innovation and a knack for solving complex problems.Key Responsibilities:Create efficient data architectures and data models to support...

  • Data Engineer I

    4 weeks ago


    Remote, India Indeed Full time

    Our MissionWe help people get jobs. We cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers.Day to DayThe Data Engineer's role is to integrate data from a variety of internal...


  • Remote, India Infiniti Research Full time

    About Us:Company OverviewWe are a rapidly growing organization built and operated by high-performance champions. Our mission is to provide cutting-edge data engineering solutions to our clients worldwide.Why Join Us?Work with a talented team of experts in data engineering.Contribute to the development of innovative data solutions that drive business growth.

  • Senior Data Engineer

    44 minutes ago


    Remote, India WebRex Studio Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer with 10+ years of experience in data transformation and ETL on large datasets. This is an exciting opportunity for a seasoned professional to join our team at Webrex Studio.The ideal candidate will have expertise in data modeling, SQL/NoSQL, ETL tools, and reporting technologies to drive...


  • Remote, India Coders Brain Technology Private Limited Full time

    Job Description :Key Responsibilities :Power BI Development :- Design, develop, and maintain interactive dashboards and reports using Power BI.- Implement advanced Power BI functionalities like DAX measures, calculated columns, and data modeling.- Ensure seamless integration of Power BI with various data sources, including Oracle and SQL databases.Data...


  • Remote, India NTT DATA Full time

    **Req ID**:225486 We are currently seeking a Enterprise Architecture Advisor to join our team in Remote, Uttar Pradesh (IN-UP), India (IN). At NTT DATA Services, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market presence and our ability...


  • Remote, India Xpetize Technology Solutions Full time

    Xpetize hiring Data Engineer with Remote opportunitySkills : Data engineerLocation : RemoteExperience : 4+ yearsNotice : Immediate onlyKey skills : - Data Engineering Expertise : Bring 3+ years of experience in building data pipelines and managing a secure, modern data stack. This includes CDC streaming ingestion using tools like Debezium into a Hudi data...


  • Remote, India Avani Technology Full time

    Job Summary:We are seeking a highly skilled Data Quality Assurance Analyst to join our team at Avani Technology. The successful candidate will have a strong background in software quality assurance, with experience in testing and validating data pipelines and processes.Key Responsibilities:Perform thorough testing of data-related processes and workflows to...

  • Data Engineer I

    3 weeks ago


    Remote, India Indeed Full time

    *Our Mission*As the world's number 1 job site\*, our mission is to help people get jobs. We strive to cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers.(\*comScore Total...


  • Remote, India Strategic Talent Partner Full time

    Job DescriptionThis position requires a highly skilled individual who can design, build, and maintain automated testing frameworks for data warehousing environments. The ideal candidate will have a solid understanding of data warehousing concepts, including ETL, OLAP, data marts, and data vault.Responsibilities- Develop and implement automation frameworks...

  • Data Engineer

    3 weeks ago


    Remote, India Sheryl strategic solutions Pvt. LTD . Full time

    Responsibilities : - Design, develop, and maintain data pipelines using Python, Snowflake, and Alteryx. - Orchestrate and manage data workflows using Airflow. - Proficiently work with Snowflake, including table creation, modifications, and data modeling. - Ensure data quality and integrity throughout the entire data lifecycle. - Collaborate with...

  • Senior Data Engineer

    3 weeks ago


    Remote, India Oportun Full time

    Job Title : Senior Data Engineer Job Location(s) : India (Remote) Work Experience : 5 to 9 Years Responsibilities : 1. Data Architecture and Design : - Lead the design and implementation of scalable, efficient, and robust data architectures to meet business needs and analytical requirements. - Collaborate with stakeholders to understand data...