Senior Lead

1 week ago

Bengaluru, Karnataka, India Peepal Technology and Management Consultant Full time

Key Responsibilities :


Data Engineer Senior Lead role is to coordinate, and execute all activities related to the requirements interpretation, design, and implementation of Data Analytics applications.

This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices to issues related to design, development, and deployment of mission-critical systems with a focus on quality application development and delivery.

This role is key to the success of the Data Engineering capability at Telstra and will be responsible and accountable for the following :

  • Lead the design, development, and maintenance of data pipelines using Spark, Python, Scala, and related technologies.
  • Work with high volume data and ensure data quality and accuracy.
  • Implement data security and privacy best practices to protect sensitive data.
  • Collaborate with data scientists and business stakeholders to understand data needs and requirements.
  • Develop and maintain documentation on data pipeline architecture, data models, and data workflows.
  • Mentor and provide technical guidance to junior team members.
  • Monitor and troubleshoot data pipelines to ensure they are performing optimally.
  • Stay up to date with the latest developments in Azure, AWS, Spark, Python, Scala, and related technologies and apply them to solve business problems.
  • Optimize data pipelines for cost and performance.
  • Automate data processing tasks and workflows to reduce manual intervention.
  • Ability to work in Agile Feature teams.
  • Provide training and educate other team members around core capabilities and helps them deliver high quality solutions and deliverables/documentation.
  • Self-Motivator to perform Design / Develop user requirements, test and deploy the changes into production.
Who we're looking for.

  • Degree level IT qualifications in Software or Systems Engineering.
  • Minimum 10 years of Big Data platform experience, consulting or technical lead / team lead role, with 3 years of team leadership experience as a solution lead, team lead, or similar roles implementing projects
  • Handson experience on Python, Spark, SQL, REST APIs and Azure Cloud experience.
  • Experience of working on File formats (Parquet/ORC/AVRO/Delta/Hudi etc.)
  • Experience with high volume data processing and data streaming technologies
  • Experience of using Orchestration tools like Controlm, Azure Data Factory, Airflow, Luigi to schedule jobs.
  • Demonstrated experience leading data engineering projects and mentoring junior team members.
  • Data engineer with expertise of working on Azure Cloud using Databricks, Kinesis/ Azure Event hub Flume/Kafka/Spark streaming, Azure Data Factory.
  • Strong experience in data modelling, schema design, and ETL development using SQL and related technologies.
  • Familiarity with data security and privacy best practices
  • Good exposure on TDD
  • Exposure on using CI tools like Git, Bitbucket, Github, Gitlab, Azure DevOps
  • Exposure on using CD tools like Jenkins, Bamboo, Azure DevOps
  • Exposure on Observability tools like Azure Monitor, Graphana etc
  • Prior experience in building or working in team building reusable frameworks.
  • Good understanding of Data Architecture and design principles. (Delta/Kappa/Lambda architecture)
  • Exposure to Open AI, Azure App insights, Telemetry experience, LangChain, Azure cognitive search/Bing search, Gen AI and Chat boat.
  • Exposure to Code Quality
  • Static and Dynamic code scans
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as highscale or distributed RDBMS and/or knowledge on NoSQL platforms.
  • Should be able to provided scalable and robust solution architecture depending on the business needs.
  • Propose best practices/standards


 Programming & Databases
  • Java /Python/Scala/ SQL Procedure. Multi tenanted databases / Spark.
)

  • Senior Analyst, Analytics

    1 week ago

    Bengaluru, Karnataka, India LEAD School Full time

    Job Title: Senior Business Analyst, AnalyticsLocation: BangaloreJob Type: Full-timePrior Experience: About 3 yearsJob Description:As the Senior Business Analyst in the Analytics team, you will be a key part of our team that will work with product and analytics leaders to solve key business problems with data.Responsibilities:Single source of truth: Own the...

  • Lead/Senior Lead

    1 week ago

    Bengaluru, Karnataka, India SemperFi Solutions Full time

    O2C-Lead/Senior Lead-C076Position: Lead/ Senior LeadExperience: 6 - 8 yrsJob Location: Hybrid(Bangalore)Shift Time: 7 PM to 4 AMNotice Period: ImmediateMandatory Skill set:- Has 6-8 years of experience into O2C.- Resumes should read about exp in O2C and people management- Bachelor's degree in business administration or a related field.- Proven experience in...

  • Senior Lead Engineer

    1 week ago

    Bengaluru, Karnataka, India Raytheon Technologies Full time

    Overview:In this position, as a Senior Lead Engineer specializing in Electronic Controllers and Advanced Structures, you will actively contribute to New Product Introduction (NPI), redesign, and maintenance tasks for Electronics LRUs utilized in the Advanced Structures product line.Position: Senior Lead EngineerPrimary Responsibilities:Experience in leading...

  • Senior Lead

    1 week ago

    Bengaluru, Karnataka, India Angel One Full time

    Angel One Limited is a Fintech company offering various financial services to its clients, with a goal to become a leading fintech organization in India. They have over 22.2 million registered clients and are consistently onboarding a significant number of new clients every month. The company focuses on creating personalized financial journeys for clients...

  • Senior Lead

    1 week ago

    Bengaluru, Karnataka, India Tiger Analytics Full time

    Job Description Senior Lead / Architect (Azure iPaas - App Eng) Chennai / Hyderabad / Bangalore (Hybrid) Who are we Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale....

  • Lead Senior Developer

    1 month ago

    Bengaluru, Karnataka, India timesjobs Full time

    Lead Senior DeveloperFull-timeCompany DescriptionInforma is a leading academic publishing, business intelligence, knowledge, and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high-quality, peer-reviewed books...

  • Lead Senior Developer

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Lead Senior DeveloperFull-timeCompany DescriptionInforma is a leading academic publishing, business intelligence, knowledge, and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high-quality, peer-reviewed books...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Informa PLC Full time

    Job DescriptionChemNetBase Lead Senior Developer RoleThe position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems.CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research industries,...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted content...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted content...

  • Hiring For Senior Lead Consultant

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    ## ### Hiring For Senior Lead Consultant - DevOps:Senior Lead Consultant - DevOpsDesired Profile Skills: AWS Solutions Architect/DevOps/SysOps Certified Java/Python Linux and Windowsbased systems Integration of AWS cloud services Cloud Formation Ansible Terraform CDKExperience: 13 years of IT experience most of which will have been in helping the design...

  • Hiring For Senior Lead Consultant

    2 months ago

    Bengaluru, Karnataka, India timesjobs Full time

    ## ### Hiring For Senior Lead Consultant - DevOps:Senior Lead Consultant - DevOpsDesired Profile Skills: AWS Solutions Architect/DevOps/SysOps Certified Java/Python Linux and Windowsbased systems Integration of AWS cloud services Cloud Formation Ansible Terraform CDKExperience: 13 years of IT experience most of which will have been in helping the design...

  • Lead/Senior Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Hiring 6+ Years Lead/Senior Software Engineer with US based MNC Product Company.Experience : 6+ YearsWork Location : Bangalore/Remote Education : BE/BTech/ME/MTech/MCA/MSRole : Lead/Senior Software Engineer - Java FullstackJob Description : Design, Develop and maintain multiple applications of highly complex distributed product Looking for problem...

  • Senior/Lead/Principal Engineer

    1 week ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are looking for a Java Engineer to join a US based Global Enterprise Product Consulting company in Bangalore.Location: BangaloreRole: Senior/Lead/PrincipalJob Description:5+ years of experience as a Java Senior/Lead/Principal EngineerStrong expertise in Object-Oriented analysis and design, software design patterns, Core Java, Multi-Threading, Data...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100. Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted content...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Informa PLC Full time

    Job Description ChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research...

  • Lead Senior Developer

    1 week ago

    Bengaluru, Karnataka, India Taylor and Francis Full time

    Job DescriptionChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE ( suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research industries,...

  • Senior IS Functional Lead

    4 weeks ago

    Bengaluru, Karnataka, India ABB Full time

    Senior IS Functional LeadTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we are embarking...

  • Senior IS Functional Lead

    2 months ago

    Bengaluru, Karnataka, India ABB Full time

    Senior IS Functional LeadTake your next career step at ABB with a global team that is energizing the transformation of society and industry to achieve a more productive, sustainable future.At ABB, we have the clear goal of driving diversity and inclusion across all dimensions: gender, LGBTQ+, abilities, ethnicity and generations. Together, we are embarking...