Lead Consultant Data Engineer, Azure+Python

3 days ago

Kolkata, West Bengal, India Genpact Full time
Job Description

Inviting applications for the role of Lead Consultant-Data Engineer, Azure+Python

Responsibilities

. Design and deploy scalable, highly available, and fault-tolerant AWS data processes using AWS data services (Glue, Lambda, Step, Redshift)

. Monitor and optimize the performance of cloud resources to ensure efficient utilization and cost-effectiveness.

. Implement and maintain security measures to protect data and systems within the AWS environment, including IAM policies, security groups, and encryption mechanisms.

. Migrate the application data from legacy databases to Cloud based solutions (Redshift, DynamoDB, etc) for high availability with low cost

. Develop application programs using Big Data technologies like Apache Hadoop, Apache Spark, etc with appropriate cloud-based services like Amazon AWS, etc.

. Build data pipelines by building ETL processes (Extract-Transform-Load)

. Implement backup, disaster recovery, and business continuity strategies for cloud-based applications and data.

. Responsible for analysing business and functional requirements which involves a review of existing system configurations and operating methodologies as well as understanding evolving business needs

. Analyse requirements/User stories at the business meetings and strategize the impact of requirements on different platforms/applications, convert the business requirements into technical requirements

. Participating in design reviews to provide input on functional requirements, product designs, schedules and/or potential problems

. Understand current application infrastructure and suggest Cloud based solutions which reduces operational cost, requires minimal maintenance but provides high availability with improved security

. Perform unit testing on the modified software to ensure that the new functionality is working as expected while existing functionalities continue to work in the same way

. Coordinate with release management, other supporting teams to deploy changes in production environment

Qualifications we seek in you

Minimum Qualifications

. Experience in designing, implementing data pipelines, build data applications, data migration on AWS

. Strong experience of implementing data lake using AWS services like Glue, Lambda, Step, Redshift

. Experience of Databricks will be added advantage

. Strong experience in Python and SQL

. Strong understanding of security principles and best practices for cloud-based environments.

. Experience with monitoring tools and implementing proactive measures to ensure system availability and performance.

. Excellent problem-solving skills and ability to troubleshoot complex issues in a distributed, cloud-based environment.

. Strong communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications/ Skills

. Master's Degree-Computer Science, Electronics, Electrical.

. AWS Data Engineering & Cloud certifications, Databricks certifications

. Experience of working with Oracle ERP

. Experience with multiple data integration technologies and cloud platforms

. Knowledge of Change & Incident Management process

-

-

-

-

-

  • Azure Data Engineer

    16 hours ago

    Kolkata, West Bengal, India GC Technologies Pvt Ltd Full time

    Data EngineerLocation: Pune -WFONP :15daysExperience : 5+yrsBudget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt LtdEnd Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, IndiQube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005JD :Minimum QualificationBachelor's degree in Computer...

  • Senior Azure Data Architect

    1 day ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Highly skilled Lead Data Engineer needed to join our team.Key responsibilities include designing, developing and optimizing data pipelines using Azure and Databricks. Hands-on work with Databricks Asset Bundles for CI/CD and environment management is also required.The ideal candidate will have strong expertise in Databricks, Azure Data Services, Python, SQL...

  • Senior Data Engineer Position

    4 hours ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Description:We seek a seasoned data engineer with expertise in designing and maintaining large-scale data processing systems.The ideal candidate will have extensive knowledge of Azure Data Factory, Data Bricks, MS Synapse, and Python programming languages.Design and develop large-scale data processing systems using Azure Data Factory, Data Bricks, MS...

  • Big Data Platform Engineer

    3 weeks ago

    Kolkata, West Bengal, India Peoplemint Consultant LLP Full time

    Job Summary :We are seeking an experienced Big Data Platform Engineer to join our banking technology team. The ideal candidate will be responsible for designing, building, and maintaining scalable big data platforms to support advanced analytics, reporting, and regulatory compliance. This role demands strong technical acumen in distributed systems, data...

  • Lead Consultant

    3 weeks ago

    Kolkata, West Bengal, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for...

  • Cloud Engineer

    3 weeks ago

    Kolkata, West Bengal, India Peoplemint Consultant LLP Full time

    Professional Summary :We are seeking a Cloud Engineer with 6+ years of experience to design, implement, and maintain scalable cloud infrastructure using AWS platforms. Candidate will demonstrate strong cloud-native architecture skills, DevOps automation, and infrastructure security best practices to support modern enterprise environments at scale.Tech Stack...

  • Principal Consultant– Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India Genpact Full time

    Job DescriptionReady to shape the future of workAt Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter,...

  • Remote Python AI Engineer

    4 weeks ago

    Kolkata, West Bengal, India Turing Full time

    Work on Real-World Problems with Global Tech ExpertsJoin a leading U.S.-based technology company as a Python Developer / AI Engineer, where you'll tackle real-world challenges and build innovative solutions alongside top global experts. This is a fully remote, contract-based opportunity ideal for developers passionate about Python, data analysis, and...

  • Assistant Vice President, Azure Data 26 AI Delivery Leader

    3 days ago

    Kolkata, West Bengal, India Genpact Full time

    Job DescriptionInviting applications for the role of Assistant Vice President, Azure Data & AI Delivery LeaderWe are seeking a dynamic and visionary Azure Data & AI Delivery Leader to spearhead the execution of large-scale, enterprise-grade data transformation and AI initiatives on the Microsoft Azure platform. This leadership role is pivotal in driving...

  • Leading Data Architect

    4 hours ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 15,63,921 - ₹ 19,99,885

    Data Engineering OpportunityWe are seeking a highly skilled Data Engineer to lead the design and development of scalable data pipelines using Azure Data Factory (ADP) and Azure Databricks (ADB).Design and develop large-scale data processing systems utilizing PySpark, ensuring seamless integration with cross-functional teams.The ideal candidate will possess...