Data Engineer

1 day ago

Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Job Summary

As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to process large datasets from various sources.

Data Modeling: Collaborate with data scientists and analysts to design and implement data models that support their analytical needs.

ETL Processes: Build and optimize Extract, Transform, Load (ETL) processes to ensure data is accurately ingested and transformed.

Data Quality: Implement data quality checks and validation processes to ensure the integrity of the data.

Data Integration: Integrate data from multiple sources, including APIs, flat files, and databases, into a unified data environment.

Performance Tuning: Monitor and optimize data processing performance to meet the demands of the organization.

Documentation: Create and maintain documentation for data pipelines, data models, and other related processes.

Collaboration: Work closely with cross-functional teams to understand data needs and provide solutions that support business goals.

Compliance and Security: Ensure data handling practices comply with relevant data privacy regulations and security standards.

Qualifications:

Experience

3+ years of experience in data engineering domain.

Technical Skills:

  • Experience with ETL process (data extraction, data cleansing, data transformation, data monitoring, data modelling)
  • Experience with Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, Azure Synapse)
  • Familiarity with Big Data systems (batch & stream processing, Spark, Hive)
  • Experience with two or more coding languages (including Python with pyspark)
  • Experience with SQL (Spark SQL, T-SQL),
  • Familiarity with code versioning (GIT, Azure DevOps)
  • Experience with various data formats (e.g. CSV, JSON, Parquet, Delta Lake)
  • Knowledge of distributed systems concepts and principles (consistency, availability, safety, durability, reliability, fault-tolerance)

Soft Skills:

  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills
  • Ability to work in a fast-paced, dynamic environment

Eager to learn new things and passionate about technology

  • Data Engineer

    3 days ago

    Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title Data Engineer100% Work from Home / RemoteWork Timings - 1:30 PM – 10:30 PMFulltime RoleJob SummaryAs a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts,...

  • Azure Data Engineer

    4 weeks ago

    Lucknow, Uttar Pradesh, India techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Sr. Azure Data Engineer ...

  • Data Scientist

    4 weeks ago

    Lucknow, Uttar Pradesh, India Tezo Full time

    Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers. We bring exceptional experiences using cutting-edge analytics, data proficiency, technology, and digital excellence.Role: Data Scientist Experience: 3-4 YearsLocation: Hyderabad (Hybrid)Tezo is seeking a highly motivated Data Scientist...

  • 11-Sep-25_Virtual Drive_Azure Data Engineer

    4 weeks ago

    Lucknow, Uttar Pradesh, India Tata Consultancy Servicess Full time

    Hello,Good day11-Sep-25_virtual Drive_Azure Data EngineerJD Orientation: -Mandatory Skill Set:Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark.Proficient with Databricks & Python.Senior developers with Full Database/ Datawarehouse/...

  • Data Specialist

    4 weeks ago

    Lucknow, Uttar Pradesh, India Forage AI Full time

    Data SpecialistJoin Forage AI as a Data Specialist. If you're a detail-oriented, tech-savvy professional who loves working with data, then this may be the right role for you You'll collaborate with our talented team of engineers who are working at the bleeding edge of data science and data automation.Responsibilities:Our technical data specialists play an...

  • Data Science Instructor

    5 days ago

    Lucknow, Uttar Pradesh, India NDMIT Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Data Science InstructorWe're a dynamic team of learners and instructors dedicated to preparing students for the next-generation data science ecosystem through immersive hands-on learning. We're searching for a passionate and experienced Data Science Instructor to join us. You'll be instrumental in shaping future data professionals, focusing on practical...

  • Research And Development Engineer

    5 days ago

    Lucknow, Uttar Pradesh, India Hydro Pneumatic Engineers (Hyd) Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHydro Pneumatic Engineers (Hyd) Pvt. Ltd. is a team of engineers collaborating with the Government of India in the fields of Defense and Space. We specialize in providing reliable engineering services for both critical and non-critical needs, ensuring cost-effective solutions. Our commitment to excellence and innovation makes us a trusted...

  • Senior Engineer-Quality

    1 week ago

    Lucknow, Uttar Pradesh, India Gloria Engineering Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Qualification :- Diploma in Mechanical Engineer /Degree in Mechanical engineerExperience :- 8 years experience in Sheet metal Auto Parts IndustryArea of working : - knowledge sheet metal process and inspection, Fixture calibration, layout inspection, supplier audits incoming inspection, knowledge of reading drawing, MSA, SPC, Data analysis. Co-ordination...

  • Data Science Intern

    4 weeks ago

    Lucknow, Uttar Pradesh, India Kavida Full time

    NLP Data Science InternDid you notice a shortage of food at supermarkets during covid? Have you heard about the recent issues in the global shipping industry? or perhaps you've heard about the shortages of microchips? These problems are called supply chain disruptions. They have been increasing in frequency and severity. Supply chain disruptions are...

  • Engineering Manager

    3 weeks ago

    Lucknow, Uttar Pradesh, India Apeiro Full time

    Aperio OverviewEnabling governments to transform healthcare and ensuring no one is left behind in receiving high quality healthcare services. Apeiro is bringing healthcare into the digital age with state-of-the-art platforms, while creating an integrated, interoperable ecosystem for all healthcare stakeholders.Position OverviewEngineering Manager who...