Data Engineer

7 days ago


Bareilly, India Huptech HR Solutions Full time

Job Post - Data Engineer

Experience :- 5+ years

Timing - 7:00 P.M. to 4:00 P.M. or 8:00 P.M. to 5:00 P.M.

Location :- Remote


Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.
  • Design, implement, and optimize complex SQL queries to extract, transform, and load (ETL) data from various sources with data Quality and Reliability
  • Develop and maintain robust data models, including star and snowflake schemas, to support analytics and reporting needs.
  • Call third party APIs to fetch data using python and perform ETL on the same.
  • Monitor and improve the performance of existing data pipelines and workflows, addressing any issues related to data quality or efficiency.
  • Designed and maintained SQL Server databases, ensuring high availability and performance.
  • Contribute to the overall system design and architecture, ensuring scalability and maintainability.
  • Stay current with emerging trends and technologies in data engineering and propose new solutions to enhance the data infrastructure.


Requirements:

  • Advanced SQL skills, with experience in writing optimized and complex queries for data extraction and transformation.
  • Strong experience with AWS cloud services or similar cloud Services (e.g.,S3, Lambda, Glue, Eventhub, EC2, IAM).
  • Familiarity with Hadoop, Spark, or similar big data processing frameworks.
  • Proficiency in Python or other programming languages for data manipulation and data automation.
  • Proficiency with ETL tools (e.g., Glue, Apache Airflow, Talend, Informatica) or custom ETL pipeline development.
  • Third party API calling with Postman, swagger or similar tools and implement calling in python.
  • Experience with data warehousing solutions such as Snowflake, Amazon Redshift, or Google Big Query.
  • Expertise in SQL Server databases, including design, optimization, and management.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and the ability to work collaboratively in a remote team environment.


Good to have :

  • Knowledge of Numpy ,Pandans and similar Python libraries


Keywords suggestions :

  • Data Engineering, SQL, ETL, AWS, Glue, Snowflake, Data modeling, API calling

  • Azure Data Engineer

    4 weeks ago


    Bareilly, India Doryo Full time

    As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your role will involve working with various stakeholders to understand data requirements, developing data pipelines, and ensuring the reliability and performance of our data infrastructure. If you are a talented data engineer...

  • Azure Data Engineer

    3 days ago


    Bareilly, India Luxoft Full time

    Project Description:Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and...


  • Bareilly, Uttar Pradesh, India Emids Full time

    About the RoleWe are seeking a highly experienced Chief Healthcare Data Engineering Strategist to join our team at Emids. In this key leadership role, you will be responsible for developing and implementing data engineering strategies that drive business growth and improvement.Job Summary:Lead the design and implementation of scalable and efficient data...

  • IICS Developer

    4 weeks ago


    Bareilly, India ExaTech Inc Full time

    IICS Developer / Data EngineerLocation : Chennai or Hyderabad (Onsite)Shift time : 6.30 to 3.30AM IST or 3 to 12.00PM ISTMajor Responsibilities:Create/Enhance ETL jobs as needed to load external feeds into warehouse tables/data mart tables.Work with an agile team to deliver and evolve the data platform servicesProvide technical support to User Acceptance and...

  • Senior Data Engineer

    1 month ago


    bareilly, India Markovate Full time

    We are seeking an experienced Senior Data Engineer with a background in data integration, ETL processes, and data warehousing. The ideal candidate will have 5-7 years of experience in data engineering, with advanced knowledge of data architecture, pipeline creation, and big data technologies. This role demands a proactive individual skilled in designing,...

  • Data Engineer

    2 months ago


    Bareilly, India Charter Global Full time

    Location: HyderabadExperience : 3-6 YrsMode of Work : Hybrid ModelJob Description:•Good hands on building data pipelines on Data tech stack with knowledge on Spark with programming using Python.•Strong expertise on SQL with 3-5 years working on multiple database systems like Postgres, Oracle and Redshift having hands-on experience in implementing data...


  • Bareilly, Uttar Pradesh, India Hexaware Technologies Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at Hexaware Technologies. This is a challenging and rewarding opportunity to design, develop, and optimize data infrastructure that supports scalable business intelligence and analytics solutions.The successful candidate will have a solid foundation in Snowflake, proficiency in dbt...

  • Senior Data Science

    1 month ago


    Bareilly, India Visa Full time

    Job DescriptionVisa is looking for Data Science – Manager (Sr. Data Scientist), who will be the responsible for leading data science engagements with our partners and supporting end-to-end delivery.What a Data Science – Sr. Data Scientist does at Visa:The Data Science – Sr. Data Scientist will be a member of VCA Data Science team in Asia Pacific. The...


  • bareilly, India Visa Full time

    Job DescriptionVisa is looking for Data Science – Manager (Sr. Data Scientist), who will be the responsible for leading data science engagements with our partners and supporting end-to-end delivery.What a Data Science – Sr. Data Scientist does at Visa:The Data Science – Sr. Data Scientist will be a member of VCA Data Science team in Asia Pacific. The...


  • Bareilly, India Moative Full time

    Energy & Utilities Data ScientistAbout MoativeMoative, an Applied AI Services company, designs AI roadmaps, builds co-pilots and predictive AI solutions for companies in energy, utilities, packaging, commerce, and other primary industries. Through Moative Labs, we aspire to build micro-products and launch AI startups in vertical markets.Our Past: We have...

  • Data Entry Specialist

    3 months ago


    bareilly, India Anarus, Inc. Full time

    Working with Excel spread sheets to analyze, research, organize and map data.ResponsibilitiesWork with supervisor to understand client requirements for researching, organizing and mapping data from Microsoft Excel Spread sheets.QualificationsStrong skills with Microsoft Excel, PDF and searching on the Internet search engines for information.


  • Bareilly, Uttar Pradesh, India Adtitude Digital Full time

    Adtitude Digital is a leading provider of technology, data, and digital marketing services. Our core mission is to deliver data-driven software solutions and digital marketing assistance to businesses and brands.This part-time remote role for an Azure Data Factory Engineer involves day-to-day tasks in Data Engineering, Data Modeling, Extract Transform Load...


  • Bareilly, Uttar Pradesh, India Mumba Technologies, Inc. Full time

    Mumba Technologies, Inc. is seeking a skilled Data Engineer to join our team in Noida. As a key member of our dynamic team, you will design and implement scalable data pipelines, visualize insights, troubleshoot complex data-related challenges, and support the operational and analytical needs of our healthcare-focused solutions.This position requires...


  • Bareilly, India Fluidata Analytics Full time

    Location- Remote Experience – 2-5 yearsNotice period – Immediate to 30 days (max) About Fluidata - Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provides end-to-end data engineering and analytics solutions to clients by using cutting-edge data technology and methodologies.  Key Responsibilities: Design,...


  • Bareilly, Uttar Pradesh, India Synechron Full time

    About the RoleWe are seeking an experienced AWS Cloud Data Architect to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data solutions using AWS services such as S3, Redshift, Glue, and EC2.Key ResponsibilitiesDevelop and maintain scalable and reliable data...


  • Bareilly, India Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...


  • Bareilly, India Dhira Full time

    Position Overview:We are seeking a Principal Data Architect with 15+ years of experience who has a comprehensive understanding of the evolution of databases, from OLTP to OLAP, and relational systems to NoSQL, Graph, and emerging Vector Databases. This role requires deep expertise in data modeling, from traditional ER modeling to advanced dimensional, graph,...

  • Data Science lead

    2 weeks ago


    Bareilly, India Inxite Out Full time

    We are seeking a highly skilled and motivated Lead Data Scientist to join our team. In this role, you will leverage cutting-edge AI and machine learning technologies to solve complex business problems, design innovative data science solutions, and deliver projects that exceed client expectations. As a leader, you will manage a team of data scientists,...


  • Bareilly, India Energy ETA Full time

    Company Overview: EnergyETA a growing start-up at the forefront of driving NetZero goals through Artificial Intelligence for commercial buildings. Our mission is to leverage cutting-edge AI technologies to optimize energy consumption, reduce carbon footprints, and accelerate the transition to sustainable building operations. We are revolutionizing energy...


  • Bareilly, India Insight Global Full time

    Required Skills & Experience- 6+ years of experience in machine learning engineering with ½ of the time being within DevOps environment- Proven experience in deploying and managing ML models in production environments using Kubernetes- Strong programming skills in Python, with experience in ML libraries such as TensorFlow, PyTorch, or scikit-learn-...