Data Engineer Leader

1 week ago

Bengaluru, Karnataka, India PERFIOS SOFTWARE SOLUTIONS PRIVATE LIMITED Full time

Data Engineering Leadership Role



We are seeking a seasoned Data Engineer Leader with a robust technical background and leadership experience to spearhead our data engineering efforts.



This role demands a deep expertise in Python, PySpark, and Shell scripting, along with a comprehensive understanding of AWS cloud services.



As a Tech Lead, you will manage a team of data engineers, oversee the development and maintenance of scalable data solutions, and ensure the seamless integration and deployment of projects.



Key Responsibilities:




  • Team Leadership: Lead, mentor, and manage a team of data engineers, providing guidance on technical and project-related matters. Foster a collaborative team environment, ensuring effective communication and knowledge sharing.
  • Data Engineering & Development: Design, develop, and optimize data pipelines and workflows using Python, PySpark, and Shell scripting. Leverage key data engineering libraries in Python, such as Pandas, Dask, and Polars, to build and maintain scalable data solutions. Apply best practices for writing clean, efficient, and optimized Python code.
  • AWS Infrastructure Management: Architect, implement, and maintain infrastructure on AWS, including services such as S3, Lambda, CloudWatch, SQS, Kinesis, EventBridge, EC2, EMR, AWS Glue, Athena, CloudFormation, and Secrets Manager. Manage and monitor APIs running on AWS API Gateway, ensuring high availability and performance.
  • Project & Deployment Management: Oversee project management on GitLab, including version control, branch management, and code reviews. Handle deployments using serverless technologies and manage CI/CD pipelines, ensuring smooth and efficient releases.
  • Database Management: Work with SQL and NoSQL databases (MongoDB) to design and manage efficient data storage and retrieval systems. Ensure data integrity, performance optimization, and security across all database systems.


Required Skills and Qualifications:




  • Technical Proficiency: Strong experience in Python and PySpark for data processing and analysis. Proficiency in Shell scripting for automation and task management.
  • AWS Expertise: In-depth knowledge of AWS services, including S3, Lambda, CloudWatch, SQS, Kinesis, EventBridge, EC2, EMR, AWS Glue, Athena, CloudFormation, and Secrets Manager.
  • Project Management: Experience managing projects on GitLab, including code versioning, branch management, and collaboration.
  • Leadership & Communication: Proven ability to lead and mentor a small team of engineers. Strong communication skills, with the ability to articulate technical concepts to non-technical stakeholders.


Why Perfios Software Solutions?



Work with cutting-edge technologies in a collaborative and innovative environment. Lead a talented team of data engineers and contribute to impactful projects. Competitive salary and benefits package, with opportunities for career growth.

  • Data Engineering Leader

    3 weeks ago

    Bengaluru, Karnataka, India 14260 GSK India Global Services Private Limited Full time

    About the RoleWe are seeking a highly skilled and motivated Data Engineering Leader to join our Data Engineering team at GSK India Global Services Private Limited. The Data Engineering Leader will work with the Commercial Pharma Tech Product & the Development teams to architect & deliver digital products that are "fit for purpose" and "fit for use"...

  • Data Engineering Leader

    2 weeks ago

    Bengaluru, Karnataka, India Lodgiq Full time

    About the Role:LodgIQ seeks an experienced Data Engineering Leader to design, build, and maintain the data infrastructure that powers its innovative hospitality solutions. As a key member of the leadership team, you will shape the company's data strategy, implement data pipelines, ensure data quality, and empower data-driven decision-making.Key...

  • Data Engineering Leader

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time

    About the RoleAdobe is seeking a talented Data Engineering Leader to join our team. As a key member of our data engineering team, you will be responsible for building, maintaining, and evolving our data platforms to meet the needs of our business.Key ResponsibilitiesDesign and implement scalable data pipelines to ingest, process, and serve data for global...

  • Data Engineering Leader

    3 days ago

    Bengaluru, Karnataka, India Wipro Full time

    About WiproWipro is a leading global information technology, consulting and business process services company.We are looking for a talented Data Engineering Leader to join our team!About the RoleThe successful candidate will be responsible for leading our data engineering efforts and driving innovation in modern data platforms and data product programs. They...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Data Engineering Leader

    3 weeks ago

    Bengaluru, Karnataka, India Wings Global Services Full time

    Azure Data Services Expertise:We are seeking a highly skilled Data Engineering Leader to join our team at Wings Global Services.The ideal candidate will have hands-on experience with:Azure Data Factory: Design, implement, and manage data pipelines using Azure Data Factory.Power BI: Develop and maintain business intelligence reports and dashboards using Power...

  • Senior Data Engineering Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Data Engineer Leader for Cybersecurity

    3 days ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time

    Job Title: Data Engineer Leader for CybersecurityPalo Alto Networks is a global leader in cybersecurity, and we're looking for a skilled Data Engineer Leader to join our team. As a key member of our Data & Analytics group, you'll be responsible for designing, implementing, and maintaining scalable data transformations and analytical solutions that support...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 296408 NTT DATA is a global leader in digital transformation and a trusted partner for businesses. We strive to innovate and optimize our services to meet the evolving needs of our clients. If you want to grow with a forward-thinking organization, we encourage you to apply.We are currently seeking a Power BI Data Engineer to join our...

  • Data Insights Leader

    3 days ago

    Bengaluru, Karnataka, India ScaleneWorks Full time

    At ScaleneWorks, we are seeking a seasoned Data Insights Leader to join our team. The successful candidate will be responsible for driving business growth through data analysis and insights.As a Data Insights Leader, you will have the opportunity to work with cutting-edge technologies and tools to develop and maintain advanced analytics solutions.The ideal...

  • Data Engineering Leader

    24 hours ago

    Bengaluru, Karnataka, India New Relic, Inc. Full time

    New Relic, Inc. is seeking an experienced Data Engineering Leader to lead our efforts in constructing a scalable and user-friendly data platform.Job OverviewWe are looking for someone with profound technical expertise to shape the vision for our data infrastructure and analysis tools. The successful candidate will establish best practices for building...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...

  • Snowflake Data Engineer and Architect

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Data Scientist Leader

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data ScientistJob Summary:We are seeking a highly skilled Senior Data Scientist to join our team at NTT DATA. As a Senior Data Scientist, you will be responsible for designing and developing machine learning systems, researching and implementing ML algorithms and tools, and selecting appropriate data sets.Key Responsibilities:Design and...

  • Lead Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...

  • Data Governance Leader

    2 weeks ago

    Bengaluru, Karnataka, India American Express Full time

    Unlock the Power of Data Management at American ExpressWe are seeking a highly skilled Data Governance Leader to join our team of talented engineers at American Express. As a Data Governance Leader, you will be responsible for architecting, coding, and shipping software that makes us an essential part of our customers' digital lives.About the RoleAs a Data...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineer - AWS and Oracle ExpertDepartment: IT - Application DevelopmentJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The...

  • Data Infrastructure Leader

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time

    About the RoleWe are seeking an experienced Data Infrastructure Leader to join our team at Databricks India. As a key member of our Software Engineering team, you will be responsible for building and scaling data infrastructure and products that power the Databricks platform.Key ResponsibilitiesDesign and develop resource management infrastructure to power...

  • Strategic Data Analytics Leader

    2 weeks ago

    Bengaluru, Karnataka, India Target Full time

    About the Role:The Sr Manager Data Analytics will play a key role in driving Target's data-driven culture, leading a team of analysts and collaborating with Product Engineering and Data Engineering teams to inform critical business decisions.This leadership position requires a strong leader who can build a high-performing team, foster innovation in data...