Data Engineer

3 weeks ago

Kanpur, Uttar Pradesh, India iXceed Solutions Full time

Role - Data Engineer

Location - Chennai (Hybrid)

Type - Permanent

Job Description:

Key Responsibilities:

  • Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).
  • Develop and maintain data processing workflows using PySpark and Python.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust data solutions.
  • Architect and implement data ingestion, transformation, and integration solutions for structured and unstructured data.
  • Optimize Spark jobs for performance and cost efficiency on cloud platforms.
  • Lead, mentor, and guide a team of data engineers, ensuring best practices in coding, testing, and deployment.
  • Establish and enforce data engineering standards, code reviews, and documentation.
  • Troubleshoot and resolve complex data pipeline issues.
  • Stay current with emerging technologies and recommend improvements to existing data infrastructure.
  • Work closely with DevOps and cloud teams to ensure smooth deployment and monitoring of data pipelines.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 10+ years of professional experience in data engineering.
  • Strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts.
  • Extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and optimization techniques.
  • Proficiency in Python and PySpark for data processing tasks.
  • Experience working with Databricks or similar cloud-based Spark platforms.
  • Solid understanding of distributed computing, big data architectures, and data modeling.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with data storage technologies like HDFS, S3, Delta Lake, and relational/non-relational databases.
  • Strong leadership skills with experience leading and mentoring engineering teams.
  • Excellent problem-solving, communication, and collaboration skills.

  • Senior Azure Stack Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 336844NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN). Job Title: Senior Azure...

  • Professional Services Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Data Dynamics Full time

    Company DescriptionData Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democratisation. With flagship AI-powered self-service data management software, the company empowers individuals across organisations to manage, secure, and optimise their data. Trusted by over 300 organisations, including 25% of the Fortune...

  • Data Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Data Engineer

    3 weeks ago

    Kanpur, Uttar Pradesh, India Suventure Full time

    Skills Required: Python, Dataproc, dataflow, GCP Cloud Run, Agile Software Development, DataForm,TERRAFORM, Big Query, Data Fusion, GCP, Cloud SQL, KAFKAExperience Required: Bachelor's degree in Computer Science, Engineering, or a related technical field 5+ years of SQL development experience 5+ years of analytics/data product development...

  • Azure Data Engineer

    5 days ago

    Kanpur, Uttar Pradesh, India CARBYNETECH Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutionsAzure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. Experience in migrating on-premise data warehouses to data...

  • Networking Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 341827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Networking Specialist to join our team in Anywhere in india, Uttar Pradesh (IN-UP), India (IN). Job OverviewThe Senior...

  • Lead Data Architect

    4 weeks ago

    Kanpur, Uttar Pradesh, India RK HR Management Private Limited Full time

    Key Responsibilities: Define and lead enterprise data strategy & governance Oversee modern data platforms (Snowflake, Databricks, AWS, Kafka) Enable AI/ML for personalization, forecasting & analytics Partner cross-functionally with Marketing, Supply Chain, Finance & R&D Lead and mentor a high-performing data engineering teamWhat We're Looking For: 18+...

  • Data & Analytics Team

    1 week ago

    Kanpur, Uttar Pradesh, India Ignitus Labs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer (Architecture & Implementation) - Team LeadScope of WorkLead technical architecture decisions for data platform modernization.Plan and execute refactoring of core data pipelines from timer-based to event-driven orchestration.Implement subscription schema alignment between Chargebee and Shopify/Recharge.Collaborate with internal Data...

  • Data Engineer

    5 days ago

    Kanpur, Uttar Pradesh, India Risebird Full time ₹ 35,00,000 - ₹ 3,50,00,000 per year

    Please find below details regarding this opportunity: About Risebird:- Leading Interview as a service platform for experts who are exploring part-time, freelance and moonlighting interviewing opportunities. Platform for talented people to monetize their idle hours in interviewing Largest interviewers network- 20k active interviewers from 4000 companies,...

  • Data Scientist

    4 weeks ago

    Kanpur, Uttar Pradesh, India Live Connections Full time

    Hi All Greetings from Live Connections We have an urgent requirement on Data Scientist - Finance Modeling role role with one of our MNC based company in Bangalore/ Chennai/ Hyderabad Location. Please find the below job description and kindly share me your updated CV to Position Title: Data Scientist - Finance Modeling role Experience Level: 5-10 Years...