Data Engineer

4 weeks ago

Lucknow, India Carnation Infotech Full time

Title Data Engineer

100% Work from Home / Remote

Work Timings - 1:30 PM – 10:30 PM

Fulltime Role

Job Summary

As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to process large datasets from various sources.

Data Modeling: Collaborate with data scientists and analysts to design and implement data models that support their analytical needs.

ETL Processes: Build and optimize Extract, Transform, Load (ETL) processes to ensure data is accurately ingested and transformed.

Data Quality: Implement data quality checks and validation processes to ensure the integrity of the data.

Data Integration: Integrate data from multiple sources, including APIs, flat files, and databases, into a unified data environment.

Performance Tuning: Monitor and optimize data processing performance to meet the demands of the organization.

Documentation: Create and maintain documentation for data pipelines, data models, and other related processes.

Collaboration: Work closely with cross-functional teams to understand data needs and provide solutions that support business goals.

Compliance and Security: Ensure data handling practices comply with relevant data privacy regulations and security standards.

Qualifications:

Experience

3+ years of experience in data engineering domain.

Technical Skills:

  • Experience with ETL process (data extraction, data cleansing, data transformation, data monitoring, data modelling)
  • Experience with Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, Azure Synapse)
  • Familiarity with Big Data systems (batch & stream processing, Spark, Hive)
  • Experience with two or more coding languages (including Python with pyspark)
  • Experience with SQL (Spark SQL, T-SQL),
  • Familiarity with code versioning (GIT, Azure DevOps)
  • Experience with various data formats (e.g. CSV, JSON, Parquet, Delta Lake)
  • Knowledge of distributed systems concepts and principles (consistency, availability, safety, durability, reliability, fault-tolerance)

Soft Skills:

  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills
  • Ability to work in a fast-paced, dynamic environment

Eager to learn new things and passionate about technology

  • Data Engineer

    1 week ago

    Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...

  • Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Job SummaryAs a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.Key...

  • Data Engineer

    4 weeks ago

    Lucknow, India RevX Full time

    Data Engineer About RevXRevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue. We're all about taking your app businesses to a new growth level. We rely on data science, innovative technology, and AI, and a skilled team, to create and deliver seamless ad experiences to delight your app users....

  • Data Quality Engineer

    1 week ago

    Lucknow, Uttar Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title : Data Quality Engineer (Data QE) Job Description :We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing...

  • Data pipeline engineer

    3 weeks ago

    Lucknow, India JRD Systems Full time

    The Role: Backend and Data Pipeline Engineer:The Team: We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you...

  • GCP Big Data Engineer

    3 weeks ago

    Lucknow, India People Prime Worldwide Full time

    About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful...

  • Network Engineering Specialist Advisor

    4 weeks ago

    Lucknow, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Specialist Advisor to join our team in Greater Noida, Uttar Pradesh (IN-UP), India (IN). Role...

  • Network Engineering Specialist Advisor

    1 week ago

    Lucknow, Uttar Pradesh, India NTT DATA North America Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:331844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Specialist Advisor to join our team in Greater Noida, Uttar Pradesh (IN-UP), India (IN).Role...

  • Data engineer/Web scapper

    6 days ago

    Lucknow, Uttar Pradesh, India QuickBid Systems Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Web Scraper / Data EngineerLocation: Remote | Experience: 1+ yearsResponsibilities:Design, develop, and maintain robust web scrapers for structured and dynamic data sources.Implement headless browser automation using Playwright, Puppeteer, or Selenium to extract content reliably.Manage session handling, cookies, CAPTCHAs, and anti-bot mechanisms...

  • Data Engineer_Immediate Joiners

    2 days ago

    Lucknow, India VXI Global Solutions Full time

    Job Title: Data EngineerAbout VXIVXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions. Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, Asia, Europe, and the Caribbean. We deliver omnichannel and multilingual support, software development, quality assurance, CX...