Current jobs related to Data Engineer - Lucknow - Carnation Infotech
-
Data Engineer
2 weeks ago
Lucknow, Uttar Pradesh, India CloudKeeper Full time ₹ 5,00,000 - ₹ 12,00,000 per yearDescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...
-
Data Quality Engineer
2 weeks ago
Lucknow, Uttar Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per yearJob Title : Data Quality Engineer (Data QE) Job Description :We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing...
-
Databricks data engineer
4 days ago
Lucknow, India Insight Global Full time** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...
-
Data pipeline engineer
4 weeks ago
Lucknow, India JRD Systems Full timeThe Role: Backend and Data Pipeline Engineer:The Team: We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you...
-
GCP Big Data Engineer
4 weeks ago
Lucknow, India People Prime Worldwide Full timeAbout Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful...
-
Sap data engineer
2 days ago
Lucknow, India Sapphire Software Solutions Inc Full timeHI FolksPlease check the JD and share your updated resume to my email and ping me on whatsapp ( ) along with your resumeSAP Data EngineerLocation: Remote in IndiaDuration: 12-month contract with extensionsCandidates' Core Skillset Must Be:Data SphereS4 HanaSACBW Data Modeling Plusses:SAP ABAP, HANA/AMDP/CDS, SOAP/OData/Rest API’s etc. Job...
-
Network Engineering Specialist Advisor
2 weeks ago
Lucknow, Uttar Pradesh, India NTT DATA North America Full time ₹ 1,04,000 - ₹ 1,30,878 per yearReq ID:331844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Engineering Specialist Advisor to join our team in Greater Noida, Uttar Pradesh (IN-UP), India (IN).Role...
-
Data engineer/Web scapper
1 week ago
Lucknow, Uttar Pradesh, India QuickBid Systems Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: Web Scraper / Data EngineerLocation: Remote | Experience: 1+ yearsResponsibilities:Design, develop, and maintain robust web scrapers for structured and dynamic data sources.Implement headless browser automation using Playwright, Puppeteer, or Selenium to extract content reliably.Manage session handling, cookies, CAPTCHAs, and anti-bot mechanisms...
-
Data Engineer_Immediate Joiners
6 days ago
Lucknow, India VXI Global Solutions Full timeJob Title: Data EngineerAbout VXIVXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions. Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, Asia, Europe, and the Caribbean. We deliver omnichannel and multilingual support, software development, quality assurance, CX...
-
Lucknow, India Extreme Networks Full timeOver 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...
Data Engineer
1 month ago
Title Data Engineer
100% Work from Home / Remote
Work Timings - 1:30 PM – 10:30 PM
Fulltime Role
Job Summary
As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.
Key Responsibilities:
Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to process large datasets from various sources.
Data Modeling: Collaborate with data scientists and analysts to design and implement data models that support their analytical needs.
ETL Processes: Build and optimize Extract, Transform, Load (ETL) processes to ensure data is accurately ingested and transformed.
Data Quality: Implement data quality checks and validation processes to ensure the integrity of the data.
Data Integration: Integrate data from multiple sources, including APIs, flat files, and databases, into a unified data environment.
Performance Tuning: Monitor and optimize data processing performance to meet the demands of the organization.
Documentation: Create and maintain documentation for data pipelines, data models, and other related processes.
Collaboration: Work closely with cross-functional teams to understand data needs and provide solutions that support business goals.
Compliance and Security: Ensure data handling practices comply with relevant data privacy regulations and security standards.
Qualifications:
Experience
3+ years of experience in data engineering domain.
Technical Skills:
- Experience with ETL process (data extraction, data cleansing, data transformation, data monitoring, data modelling)
- Experience with Microsoft Azure (Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, Azure Synapse)
- Familiarity with Big Data systems (batch & stream processing, Spark, Hive)
- Experience with two or more coding languages (including Python with pyspark)
- Experience with SQL (Spark SQL, T-SQL),
- Familiarity with code versioning (GIT, Azure DevOps)
- Experience with various data formats (e.g. CSV, JSON, Parquet, Delta Lake)
- Knowledge of distributed systems concepts and principles (consistency, availability, safety, durability, reliability, fault-tolerance)
Soft Skills:
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Ability to work in a fast-paced, dynamic environment
Eager to learn new things and passionate about technology
