Data Engineer
2 weeks ago
Profile Overview
We're seeking talented Data/ML-Ops Engineers to join our team. In this role, you'll play a key part in the data lifecycle, transforming raw data into valuable insights for data analysis and machine learning projects. You'll design and build data pipelines, ensuring data quality and collaborating closely with data scientists and business users.
Responsibilities
- Analyze raw data, identify and address quality issues (completeness, duplicates, outliers) using SQL, Python libraries (Pandas, NumPy), and other data manipulation tools.
- Design, develop, and maintain data pipelines for data extraction, transformation, and loading (ETL)
- Perform data integrity checks and automate manual data processes for efficiency.
- Utilize statistical analysis and data visualization methods to explore data and prepare it for modelling.
- Deliver data sets in formats suitable for machine learning algorithms used by data scientists.
- Collaborate with data scientists and business users to understand data structures, variables, and systems.
- Troubleshoot data-related technical issues with data analysts and business teams.
- Define user access and ensure data distribution to the right users in the appropriate format and timeframe.
Technical Skills & Requirements
- Essential:
2+ years of experience in data manipulation and wrangling for analytics.
Proficiency in SQL (including stored procedures) or NoSQL databases.
Strong understanding of data structures and design principles.
Experience with Python libraries for data manipulation (Pandas, NumPy, etc.)
Experience with Azure cloud tools like Azure Data Factory, Synapse, etc. and the medallion lakehouse architecture.
Experience in containerizing solutions for CI/CD (Continuous Integration/Continuous Deployment) flows using Azure Containers, Kubernetes, Docker etc.
- Desirable:
Certification in MS SQL or a similar data warehousing or data management solution (SSIS/SSRS/SSAS).
Familiarity with cloud platforms (AWS, GCP, Azure) a plus.
Experience with data warehousing concepts and tools.
Knowledge of data version control systems (e.g., Git).
Soft Skills
Excellent collaboration skills to work effectively with data scientists, analysts, and business users.
Positive and proactive approach to problem-solving.
Strong communication skills to explain technical concepts to non-technical audiences.
-
Data Engineer
4 days ago
Lucknow, India Cephei Infotech Full timeCompany DescriptionAt Cephei Infotech, located in Ahmedabad, we are a team of digital transformation experts dedicated to helping businesses navigate their digital journey. Our focus is on providing innovative, scalable, and customized digital solutions to drive growth, enhance efficiency, and improve customer experiences. We prioritize building strong...
-
Data Engineer
2 weeks ago
Lucknow, India Hanuma InfoTech Full timeAs a Senior Data Engineer at JLL, you will:Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirementsDevelop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build...
-
Data Engineer
2 weeks ago
Lucknow, India Hanuma InfoTech Full timeResponsibilities:Build ML infrastructure in the cloud environmentDevelop and maintain data pipelines to support machine learning models, including data cleaning, prep-processing data, training and evaluation of modelsSupport Prompt Engineering development that utilizes LLM and deep learning frameworksCollaborate with teams to design and implement solutions,...
-
Data Science Engineer
2 weeks ago
lucknow, India Banyan Cloud Full timeAbout US Honest Data technologies Pvt Ltd, is a wholly owned subsidiary of Banyan Cloud, USA, the Cyber Security Product Company, headquartered in San Jose, California, USA, owning the SaaS product “Banyan Cloud”, first of its kind Cyber Security CNAP Platform that simplifies the code to cloud security for multi cloud & On-premises environments. It's a...
-
Google Cloud Data Engineer
2 weeks ago
Lucknow, India Tech Mahindra Full timeGCP Data Engineer (Developer) • Mandatory Skills: - o Senior Data Engineer with Cloud (GCP) (Experience - 5 to 12 Years) o Mandatory Google Cloud Big Query Scripting Skills or Cloud, SQL hands-on experience o Mandatory SQL PL/SQL Scripting Experience [High level expertise and hands-on work] o Mandatory shell scripting Or Python [High level expertise and...
-
Senior Data Engineer
1 month ago
Lucknow, India Databerry Technologies Pvt Ltd Full timeAs a member of the Data Engineering team, you will...Implement continuous improvements to our data governance practices and implement data quality improvementsPartner with key stakeholders to understand and refine data product requirementsDesign and develop reliable data product pipelines that transform data at scale, orchestrated via Airflow, using SQL and...
-
AWS Data Engineer
5 days ago
Lucknow, India True Tech Professionals Full timeJob Title:AWS Data EngineerLocation:GurgaonMode:Hybrid (Combination of office and remote work)Experience Required:4 to 9 YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using AWS services.LeveragePythonandPySparkfor data processing and transformation.Work withAWS Gluefor ETL processes, ensuring efficient data movement and...
-
Senior Data Engineer
3 weeks ago
Lucknow, India Synechron Full timeJob Title: AWS Data EngineerExperience: 7-12 Years Job Description:We are seeking an AWS Data Engineer with a strong foundation in AWS services and data ingestion using APIs. This individual will be instrumental in architecting and building scalable data solutions, leveraging AWS technologies such as S3, Redshift, Glue, and EC2 to support our data...
-
Azure Data Engineer
1 month ago
Lucknow, India Tredence Inc. Full timeAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay...
-
Senior Data Engineer
1 month ago
Lucknow, India USEFULBI CORPORATION Full timeJob Role : Sr. Data EngineerLocation : Bengaluru/Lucknow (Hybrid)Job Description : - Minimum 8 years' Experience in Data Engineering.- Must have good knowledge and experience in Python.- Mush have good Knowledge of Pyspark or Spark. - Must have good experience in AWS (Glue, EMR)- Typically requires relevant analysis work and domain-area work...
-
Principal Architect Data Engineering
4 weeks ago
Lucknow, India Techs to Suit Inc Full timeClient- Renowned Mid sized IT CompanyLocation - BangaloreJoining time - 2 monthsDesignation - Associate Director / Principal Architect Data EngineeringKey Skills - Role is 70% Technical. 30 % managerial as need to manage team of 10 to 15Must have experience in Multi CloudMust be from Data warehousing development backgroundCandidates Must Have:13 years of...
-
Azure Data Engineer
4 weeks ago
Lucknow, India Optimum Solutions Pte Ltd Full time5 years of experience in building data solutions using relevant technologies, with a focus on Azure data platforms and services.Strong expertise in Azure data technologies such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Purview.Proficiency in programming languages such as Python, PySpark, SQL, and familiarity with data...
-
Senior Data Scientist
2 days ago
Lucknow, India Material Full timeAbout US:- We turn customer challenges into growth opportunities. Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences. We use deep human insights, design innovation and data to create experiences...
-
Data Science Trainer
4 months ago
Lucknow, India Hanumant Technology Pvt. Ltd. Full timeJob Profile: Data Scientist Engineer Experience: Min 0-10 years experience Job Location: Lucknow Qualification: Diploma / Graduate / Postgraduate. Technical Skills: Programming languages &tools: MYSQL and Python(NumPy, Pandas), MATLAB,GitHub, R Language. Data visualization: Excel,Power BI, Matplotlib, Seabor etc.. Get In Touch: Call Now : 7392036155,...
-
Snowflake Engineer
4 weeks ago
Lucknow, India InCommon Full timeSnowflake Engineer Job Type: Full-Time Location: India (Remote)⏱️ Work Timings: 9 AM to 7 PM IST | Monday to Friday ️ Experience Required: 8-10+ Years of relevant experience⌛ Hiring Timeline: Immediate - 30 Days Hiring Process: Resume review - Initial screen - Technical Interviews (3) - Leadership & Behavior InterviewsAbout the companyIncommon is...
-
Data Entry Specialist
3 months ago
Lucknow, India Velocious Solutions Pvt. Ltd. Full timeCompany DescriptionVelocious Solutions Pvt. Ltd. is a Hyderabad-based company founded in 2017. We are committed to helping our clients achieve their goals of higher quality and shorter schedules. Our projects span various sectors including Healthcare, Education, Banking, Finance, E-Commerce, Energy and utilities, Public work, Housing and urban development,...
-
Java full stack developer +Data science
2 weeks ago
lucknow, India Live Connections Full timeExp : 16yrs to 20yrs Primary skill : Java full stack developer AWS/Azure Data science Architect' Design pattern Job description: Architecture patterns Design Patterns Java full stack developer Solution Engineering Data / Information Architecture Cloud Engineering – AWS / Azure Web services (i.e. REST, gRPC) using microservices Docker and Kubernetes...
-
Data Science Intern
4 days ago
Lucknow, India Sony Research India Full timeSony Research India is driving cutting-edge research and development in various locations around the globe, including laboratories in Japan, the United States, Europe, and Asia. We endeavor to create new technology, products, and services while sustaining Sony Group’s diverse businesses in electronics, entertainment, and financial fields. For our research...
-
Machine Learning Engineer
2 days ago
lucknow, India I, Saras Full timeRole : Machine Learning Engineer Job location : Chennai About us At I, Saras, we develop AI applications for students, teachers and professionals. Job Opportunity: Seeking a Highly Motivated and Experienced ML Engineer. You will be a founding engineer for our startup. Why you should apply for I, Saras? Work in emerging tech like AI, ML and NLP....
-
Performance Engineer
2 weeks ago
Lucknow, India Tekskills Inc. Full timeRole: Performance Tester/EngineerLocation:ChennaiPerformance Testing Experience : 5+ yearsPerformance Engineer focused on strengthening quality and performance of different products. Water Fall, Agile and Scrum methodologies while monitoring performance, reviewing processes and recommending updates.Expertise in Test Planning, Test Estimation, Test Strategy,...