Data Engineer

7 days ago

Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Job Summary

As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to process large datasets from various sources.

Data Modeling: Collaborate with data scientists and analysts to design and implement data models that support their analytical needs.

ETL Processes: Build and optimize Extract, Transform, Load (ETL) processes to ensure data is accurately ingested and transformed.

Data Quality: Implement data quality checks and validation processes to ensure the integrity of the data.

Data Integration: Integrate data from multiple sources, including APIs, flat files, and databases, into a unified data environment.

Performance Tuning: Monitor and optimize data processing performance to meet the demands of the organization.

Documentation: Create and maintain documentation for data pipelines, data models, and other related processes.

Collaboration: Work closely with cross-functional teams to understand data needs and provide solutions that support business goals.

Compliance and Security: Ensure data handling practices comply with relevant data privacy regulations and security standards.

Qualifications:

Experience

3+ years of experience in data engineering domain.

Technical Skills:

  • Experience with ETL process (data extraction, data cleansing, data transformation, data monitoring, data modelling)
  • Experience with Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, Azure Synapse)
  • Familiarity with Big Data systems (batch & stream processing, Spark, Hive)
  • Experience with two or more coding languages (including Python with pyspark)
  • Experience with SQL (Spark SQL, T-SQL),
  • Familiarity with code versioning (GIT, Azure DevOps)
  • Experience with various data formats (e.g. CSV, JSON, Parquet, Delta Lake)
  • Knowledge of distributed systems concepts and principles (consistency, availability, safety, durability, reliability, fault-tolerance)

Soft Skills:

  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills
  • Ability to work in a fast-paced, dynamic environment

Eager to learn new things and passionate about technology

  • Data Engineer

    1 week ago

    Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title Data Engineer100% Work from Home / RemoteWork Timings - 1:30 PM – 10:30 PMFulltime RoleJob SummaryAs a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts,...

  • Data Engineer

    15 hours ago

    Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...

  • Data Quality Engineer

    2 days ago

    Lucknow, Uttar Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title : Data Quality Engineer (Data QE) Job Description :We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing...

  • Network Engineering Specialist Advisor

    2 days ago

    Lucknow, Uttar Pradesh, India NTT DATA North America Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:331844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Specialist Advisor to join our team in Greater Noida, Uttar Pradesh (IN-UP), India (IN).Role...

  • Principal Data Scientist

    10 hours ago

    Lucknow, Uttar Pradesh, India Benovymed Healthcare Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design, develop, and optimize NLP models for text classification, sentiment analysis, chatbots, and language generation.Work with deep learning models such as Transformers (BERT, GPT, LSTMs) to enhance NLP capabilities.Implement and fine-tune machine learning algorithms for text analytics and information extraction.Collaborate with data...

  • Principal Data Scientist

    4 days ago

    Lucknow, Uttar Pradesh, India Benovymed Healthcare Private Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Position : Principal Data Scientist / Sr Data Scientists /Data Scientist / Jr. Data Scientist / Data Science Intern / Machine Learning Engineer-Global Tech AI Health Startup.Joining : Immediately.Job Location : Lucknow. Global HQ, Benovymed Global Technology Development and Innovation Center & Benovymed Global R and D, and AI Health Innovation Center...

  • Data Science Instructor

    2 weeks ago

    Lucknow, Uttar Pradesh, India NDMIT Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Data Science InstructorWe're a dynamic team of learners and instructors dedicated to preparing students for the next-generation data science ecosystem through immersive hands-on learning. We're searching for a passionate and experienced Data Science Instructor to join us. You'll be instrumental in shaping future data professionals, focusing on practical...

  • Research And Development Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India Hydro Pneumatic Engineers (Hyd) Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHydro Pneumatic Engineers (Hyd) Pvt. Ltd. is a team of engineers collaborating with the Government of India in the fields of Defense and Space. We specialize in providing reliable engineering services for both critical and non-critical needs, ensuring cost-effective solutions. Our commitment to excellence and innovation makes us a trusted...

  • NDT Engineer

    3 days ago

    Lucknow, Uttar Pradesh, India Hydro Pneumatic Engineers (Hyd) Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHydro Pneumatic Engineers (Hyd) Pvt. Ltd. is a team of engineers collaborating with the Government of India in the Defense and Space sectors. We offer dependable engineering services tailored to meet both critical and non-critical needs, all while providing cost-effective solutions. Our expertise ensures the highest standards in service...

  • Data Structures and Algorithms Trainer

    2 weeks ago

    Lucknow, Uttar Pradesh, India HapGen Education Full time ₹ 9,00,000 - ₹ 18,00,000 per year

    Job Description: We are seeking an experienced and passionate Data Structures and Algorithms Trainer to join our team. The ideal candidate will have a strong background in computer science, proficiency in C, C++, and Python, and a proven track record of teaching and mentoring students. This role requires onsite training, providing hands-on, interactive...