Data Engineer

23 hours ago


Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Title Data Engineer

100% Work from Home / Remote

Work Timings - 1:30 PM – 10:30 PM

Fulltime Role

Job Summary

As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to process large datasets from various sources.

Data Modeling: Collaborate with data scientists and analysts to design and implement data models that support their analytical needs.

ETL Processes: Build and optimize Extract, Transform, Load (ETL) processes to ensure data is accurately ingested and transformed.

Data Quality: Implement data quality checks and validation processes to ensure the integrity of the data.

Data Integration: Integrate data from multiple sources, including APIs, flat files, and databases, into a unified data environment.

Performance Tuning: Monitor and optimize data processing performance to meet the demands of the organization.

Documentation: Create and maintain documentation for data pipelines, data models, and other related processes.

Collaboration: Work closely with cross-functional teams to understand data needs and provide solutions that support business goals.

Compliance and Security: Ensure data handling practices comply with relevant data privacy regulations and security standards.

Qualifications:

Experience

3+ years of experience in data engineering domain.

Technical Skills:

  • Experience with ETL process (data extraction, data cleansing, data transformation, data monitoring, data modelling)
  • Experience with Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, Azure Synapse)
  • Familiarity with Big Data systems (batch & stream processing, Spark, Hive)
  • Experience with two or more coding languages (including Python with pyspark)
  • Experience with SQL (Spark SQL, T-SQL),
  • Familiarity with code versioning (GIT, Azure DevOps)
  • Experience with various data formats (e.g. CSV, JSON, Parquet, Delta Lake)
  • Knowledge of distributed systems concepts and principles (consistency, availability, safety, durability, reliability, fault-tolerance)

Soft Skills:

  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills
  • Ability to work in a fast-paced, dynamic environment

Eager to learn new things and passionate about technology


  • Data Engineer

    2 weeks ago


    Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...


  • Lucknow, Uttar Pradesh, India QuickBid Systems Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Web Scraper / Data EngineerLocation: Remote | Experience: 1+ yearsResponsibilities:Design, develop, and maintain robust web scrapers for structured and dynamic data sources.Implement headless browser automation using Playwright, Puppeteer, or Selenium to extract content reliably.Manage session handling, cookies, CAPTCHAs, and anti-bot mechanisms...


  • Lucknow, Uttar Pradesh, India Benovymed Healthcare Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design, develop, and optimize NLP models for text classification, sentiment analysis, chatbots, and language generation.Work with deep learning models such as Transformers (BERT, GPT, LSTMs) to enhance NLP capabilities.Implement and fine-tune machine learning algorithms for text analytics and information extraction.Collaborate with data...


  • Lucknow, Uttar Pradesh, India NDMIT Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Data Science InstructorWe're a dynamic team of learners and instructors dedicated to preparing students for the next-generation data science ecosystem through immersive hands-on learning. We're searching for a passionate and experienced Data Science Instructor to join us. You'll be instrumental in shaping future data professionals, focusing on practical...


  • Lucknow, Uttar Pradesh, India Hydro Pneumatic Engineers (Hyd) Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHydro Pneumatic Engineers (Hyd) Pvt. Ltd. is a team of engineers collaborating with the Government of India in the fields of Defense and Space. We specialize in providing reliable engineering services for both critical and non-critical needs, ensuring cost-effective solutions. Our commitment to excellence and innovation makes us a trusted...


  • Lucknow, Uttar Pradesh, India Gloria Engineering Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Qualification :- Diploma in Mechanical Engineer /Degree in Mechanical engineerExperience :- 8 years experience in Sheet metal Auto Parts IndustryArea of working : - knowledge sheet metal process and inspection, Fixture calibration, layout inspection, supplier audits incoming inspection, knowledge of reading drawing, MSA, SPC, Data analysis. Co-ordination...


  • Lucknow, Uttar Pradesh, India HapGen Education Full time ₹ 9,00,000 - ₹ 18,00,000 per year

    Job Description: We are seeking an experienced and passionate Data Structures and Algorithms Trainer to join our team. The ideal candidate will have a strong background in computer science, proficiency in C, C++, and Python, and a proven track record of teaching and mentoring students. This role requires onsite training, providing hands-on, interactive...


  • Lucknow, Uttar Pradesh, India CS Tech AI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Location: LucknowExperience: 5 years (PG) or 10 years (UG) in foundation engineering and soil analysisQualification: B.E./B.Tech or M.E./M.Tech in Geotechnical, Soil Mechanics, or Civil EngineeringRequirements:Conduct geotechnical surveys and soil testing to assess sub-surface conditions.Analyze soil data and interpret findings to guide foundation design and...


  • Lucknow, Uttar Pradesh, India Appscribed Full time

    Company DescriptionAt Appscribed, we are building a Deep tech-focused AI Engineering Team for our Enterprise Product and Service delivery Arms.Role DescriptionThis is a full-time on-site role for an Artificial Intelligence Engineer located in Lucknow. The Artificial Intelligence Engineer will be responsible for developing and implementing AI models,...

  • Sr. Engineer

    1 week ago


    Lucknow, Uttar Pradesh, India Jubilant Pharmova Limited Full time US$ 1,50,000 - US$ 2,00,000 per year

    Jubilant Bhartia GroupJubilant Bhartia Group is a global conglomerate founded by Mr. Shyam S Bhartia and Mr. Hari S Bhartia with strong presence in diverse sectors like Pharmaceuticals, Contract Research and Development Services, Proprietary Novel Drugs, Life Science Ingredients, Agri Products, Performance Polymers, Food Service (QSR), Food, Auto, Consulting...