Data Engineer

2 weeks ago


lucknow, India Spinnaker Analytics Full time

Profile Overview

We're seeking talented Data/ML-Ops Engineers to join our team. In this role, you'll play a key part in the data lifecycle, transforming raw data into valuable insights for data analysis and machine learning projects. You'll design and build data pipelines, ensuring data quality and collaborating closely with data scientists and business users.


Responsibilities

  • Analyze raw data, identify and address quality issues (completeness, duplicates, outliers) using SQL, Python libraries (Pandas, NumPy), and other data manipulation tools.
  • Design, develop, and maintain data pipelines for data extraction, transformation, and loading (ETL)
  • Perform data integrity checks and automate manual data processes for efficiency.
  • Utilize statistical analysis and data visualization methods to explore data and prepare it for modelling.
  • Deliver data sets in formats suitable for machine learning algorithms used by data scientists.
  • Collaborate with data scientists and business users to understand data structures, variables, and systems.
  • Troubleshoot data-related technical issues with data analysts and business teams.
  • Define user access and ensure data distribution to the right users in the appropriate format and timeframe.


Technical Skills & Requirements

  • Essential:

2+ years of experience in data manipulation and wrangling for analytics.

Proficiency in SQL (including stored procedures) or NoSQL databases.

Strong understanding of data structures and design principles.

Experience with Python libraries for data manipulation (Pandas, NumPy, etc.)

Experience with Azure cloud tools like Azure Data Factory, Synapse, etc. and the medallion lakehouse architecture.

Experience in containerizing solutions for CI/CD (Continuous Integration/Continuous Deployment) flows using Azure Containers, Kubernetes, Docker etc.

  • Desirable:

Certification in MS SQL or a similar data warehousing or data management solution (SSIS/SSRS/SSAS).

Familiarity with cloud platforms (AWS, GCP, Azure) a plus.

Experience with data warehousing concepts and tools.

Knowledge of data version control systems (e.g., Git).

Soft Skills

Excellent collaboration skills to work effectively with data scientists, analysts, and business users.

Positive and proactive approach to problem-solving.

Strong communication skills to explain technical concepts to non-technical audiences.



  • Data Engineer

    4 days ago


    Lucknow, India Cephei Infotech Full time

    Company DescriptionAt Cephei Infotech, located in Ahmedabad, we are a team of digital transformation experts dedicated to helping businesses navigate their digital journey. Our focus is on providing innovative, scalable, and customized digital solutions to drive growth, enhance efficiency, and improve customer experiences. We prioritize building strong...

  • Data Engineer

    2 weeks ago


    Lucknow, India Hanuma InfoTech Full time

    As a Senior Data Engineer at JLL, you will:Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirementsDevelop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build...

  • Data Engineer

    2 weeks ago


    Lucknow, India Hanuma InfoTech Full time

    Responsibilities:Build ML infrastructure in the cloud environmentDevelop and maintain data pipelines to support machine learning models, including data cleaning, prep-processing data, training and evaluation of modelsSupport Prompt Engineering development that utilizes LLM and deep learning frameworksCollaborate with teams to design and implement solutions,...

  • Data Science Engineer

    2 weeks ago


    lucknow, India Banyan Cloud Full time

    About US Honest Data technologies Pvt Ltd, is a wholly owned subsidiary of Banyan Cloud, USA, the Cyber Security Product Company, headquartered in San Jose, California, USA, owning the SaaS product “Banyan Cloud”, first of its kind Cyber Security CNAP Platform that simplifies the code to cloud security for multi cloud & On-premises environments. It's a...


  • Lucknow, India Tech Mahindra Full time

    GCP Data Engineer (Developer) • Mandatory Skills: - o Senior Data Engineer with Cloud (GCP) (Experience - 5 to 12 Years) o Mandatory Google Cloud Big Query Scripting Skills or Cloud, SQL hands-on experience o Mandatory SQL PL/SQL Scripting Experience [High level expertise and hands-on work] o Mandatory shell scripting Or Python [High level expertise and...

  • Senior Data Engineer

    1 month ago


    Lucknow, India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will...Implement continuous improvements to our data governance practices and implement data quality improvementsPartner with key stakeholders to understand and refine data product requirementsDesign and develop reliable data product pipelines that transform data at scale, orchestrated via Airflow, using SQL and...

  • AWS Data Engineer

    5 days ago


    Lucknow, India True Tech Professionals Full time

    Job Title:AWS Data EngineerLocation:GurgaonMode:Hybrid (Combination of office and remote work)Experience Required:4 to 9 YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using AWS services.LeveragePythonandPySparkfor data processing and transformation.Work withAWS Gluefor ETL processes, ensuring efficient data movement and...

  • Senior Data Engineer

    3 weeks ago


    Lucknow, India Synechron Full time

    Job Title: AWS Data EngineerExperience: 7-12 Years Job Description:We are seeking an AWS Data Engineer with a strong foundation in AWS services and data ingestion using APIs. This individual will be instrumental in architecting and building scalable data solutions, leveraging AWS technologies such as S3, Redshift, Glue, and EC2 to support our data...

  • Azure Data Engineer

    1 month ago


    Lucknow, India Tredence Inc. Full time

    About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...

  • Senior Data Engineer

    1 month ago


    Lucknow, India USEFULBI CORPORATION Full time

    Job Role : Sr. Data EngineerLocation : Bengaluru/Lucknow (Hybrid)Job Description : - Minimum 8 years' Experience in Data Engineering.- Must have good knowledge and experience in Python.- Mush have good Knowledge of Pyspark or Spark. - Must have good experience in AWS (Glue, EMR)- Typically requires relevant analysis work and domain-area work...


  • Lucknow, India Techs to Suit Inc Full time

    Client- Renowned Mid sized IT CompanyLocation - BangaloreJoining time - 2 monthsDesignation - Associate Director / Principal Architect Data EngineeringKey Skills - Role is 70% Technical. 30 % managerial as need to manage team of 10 to 15Must have experience in Multi CloudMust be from Data warehousing development backgroundCandidates Must Have:13 years of...

  • Azure Data Engineer

    4 weeks ago


    Lucknow, India Optimum Solutions Pte Ltd Full time

    5 years of experience in building data solutions using relevant technologies, with a focus on Azure data platforms and services.Strong expertise in Azure data technologies such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Purview.Proficiency in programming languages such as Python, PySpark, SQL, and familiarity with data...


  • Lucknow, India Material Full time

    About US:- We turn customer challenges into growth opportunities. Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences. We use deep human insights, design innovation and data to create experiences...

  • Data Science Trainer

    4 months ago


    Lucknow, India Hanumant Technology Pvt. Ltd. Full time

    Job Profile: Data Scientist Engineer Experience: Min 0-10 years experience Job Location: Lucknow Qualification: Diploma / Graduate / Postgraduate. Technical Skills: Programming languages &tools: MYSQL and Python(NumPy, Pandas), MATLAB,GitHub, R Language. Data visualization: Excel,Power BI, Matplotlib, Seabor etc.. Get In Touch: Call Now : 7392036155,...

  • Snowflake Engineer

    4 weeks ago


    Lucknow, India InCommon Full time

    Snowflake Engineer Job Type: Full-Time Location: India (Remote)⏱️ Work Timings: 9 AM to 7 PM IST | Monday to Friday ️ Experience Required: 8-10+ Years of relevant experience⌛ Hiring Timeline: Immediate - 30 Days Hiring Process: Resume review - Initial screen - Technical Interviews (3) - Leadership & Behavior InterviewsAbout the companyIncommon is...

  • Data Entry Specialist

    3 months ago


    Lucknow, India Velocious Solutions Pvt. Ltd. Full time

    Company DescriptionVelocious Solutions Pvt. Ltd. is a Hyderabad-based company founded in 2017. We are committed to helping our clients achieve their goals of higher quality and shorter schedules. Our projects span various sectors including Healthcare, Education, Banking, Finance, E-Commerce, Energy and utilities, Public work, Housing and urban development,...


  • lucknow, India Live Connections Full time

    Exp : 16yrs to 20yrs Primary skill : Java full stack developer AWS/Azure Data science Architect' Design pattern Job description: Architecture patterns Design Patterns Java full stack developer Solution Engineering Data / Information Architecture Cloud Engineering – AWS / Azure Web services (i.e. REST, gRPC) using microservices Docker and Kubernetes...

  • Data Science Intern

    4 days ago


    Lucknow, India Sony Research India Full time

    Sony Research India is driving cutting-edge research and development in various locations around the globe, including laboratories in Japan, the United States, Europe, and Asia. We endeavor to create new technology, products, and services while sustaining Sony Group’s diverse businesses in electronics, entertainment, and financial fields. For our research...


  • lucknow, India I, Saras Full time

    Role : Machine Learning Engineer Job location : Chennai   About us At I, Saras, we develop AI applications for students, teachers and professionals. Job Opportunity: Seeking a Highly Motivated and Experienced ML Engineer. You will be a founding engineer for our startup.   Why you should apply for I, Saras? Work in emerging tech like AI, ML and NLP....

  • Performance Engineer

    2 weeks ago


    Lucknow, India Tekskills Inc. Full time

    Role: Performance Tester/EngineerLocation:ChennaiPerformance Testing Experience : 5+ yearsPerformance Engineer focused on strengthening quality and performance of different products. Water Fall, Agile and Scrum methodologies while monitoring performance, reviewing processes and recommending updates.Expertise in Test Planning, Test Estimation, Test Strategy,...