Senior Lead

4 weeks ago

Bangalore, India Peepal Technology and Management Consultant Full time

Key Responsibilities :

Data Engineer Senior Lead role is to coordinate, and execute all activities related to the requirements interpretation, design, and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices to issues related to design, development, and deployment of mission-critical systems with a focus on quality application development and delivery.

This role is key to the success of the Data Engineering capability at Telstra and will be responsible and accountable for the following :

- Lead the design, development, and maintenance of data pipelines using Spark, Python, Scala, and related technologies.

- Work with high volume data and ensure data quality and accuracy.

- Implement data security and privacy best practices to protect sensitive data.

- Collaborate with data scientists and business stakeholders to understand data needs and requirements.

- Develop and maintain documentation on data pipeline architecture, data models, and data workflows.

- Mentor and provide technical guidance to junior team members.

- Monitor and troubleshoot data pipelines to ensure they are performing optimally.

- Stay up to date with the latest developments in Azure, AWS, Spark, Python, Scala, and related technologies and apply them to solve business problems.

- Optimize data pipelines for cost and performance.

- Automate data processing tasks and workflows to reduce manual intervention.

- Ability to work in Agile Feature teams.

- Provide training and educate other team members around core capabilities and helps them deliver high quality solutions and deliverables/documentation.

- Self-Motivator to perform Design / Develop user requirements, test and deploy the changes into production.

Who we're looking for.

- Degree level IT qualifications in Software or Systems Engineering.

- Minimum 10 years of Big Data platform experience, consulting or technical lead / team lead role, with 3 years of team leadership experience as a solution lead, team lead, or similar roles implementing projects

- Hands-on experience on Python, Spark, SQL, REST APIs and Azure Cloud experience.

- Experience of working on File formats (Parquet/ORC/AVRO/Delta/Hudi etc.)

- Experience with high volume data processing and data streaming technologies

- Experience of using Orchestration tools like Control-m, Azure Data Factory, Airflow, Luigi to schedule jobs.

- Demonstrated experience leading data engineering projects and mentoring junior team members.

- Data engineer with expertise of working on Azure Cloud using Databricks, Kinesis/ Azure Event hub Flume/Kafka/Spark streaming, Azure Data Factory.

- Strong experience in data modelling, schema design, and ETL development using SQL and related technologies.

- Familiarity with data security and privacy best practices

- Good exposure on TDD

- Exposure on using CI tools like Git, Bitbucket, Github, Gitlab, Azure DevOps

- Exposure on using CD tools like Jenkins, Bamboo, Azure DevOps

- Exposure on Observability tools like Azure Monitor, Graphana etc

- Prior experience in building or working in team building reusable frameworks.

- Good understanding of Data Architecture and design principles. (Delta/Kappa/Lambda architecture)

- Exposure to Open AI, Azure App insights, Telemetry experience, LangChain, Azure cognitive search/Bing search, Gen AI and Chat boat.

- Exposure to Code Quality - Static and Dynamic code scans

- Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.

- Should be able to provided scalable and robust solution architecture depending on the business needs.

- Propose best practices/standards

- Programming & Databases - Java /Python/Scala/ SQL Procedure. Multi tenanted databases / Spark.

(ref:hirist.tech)

  • City Head

    5 days ago

    bangalore, India Antara Senior Care Full time

    Antara Assisted care is seeking a dedicated and experienced City Head of Operations to oversee and manage our senior care homes and care at home services in Bangalore. The City Head will play a crucial role in ensuring the highest quality of care and services for our residents and clients.Key Responsibilities:- Oversee the day-to-day operations of the senior...

  • City Head

    5 days ago

    bangalore, India Antara Senior Care Full time

    Antara Assisted care is seeking a dedicated and experienced City Head of Operations to oversee and manage our senior care homes and care at home services in Bangalore. The City Head will play a crucial role in ensuring the highest quality of care and services for our residents and clients. Key Responsibilities: - Oversee the day-to-day operations of the...

  • Senior Tech Lead

    2 weeks ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Senior Tech Lead level profile for Product Innovation teamSenior Tech LeadArea of expertise : Product DevelopmentExperience : 8 To 10 Yrs A vacancy now exists for a highly motivated and resourceful Senior Developer for the Product Innovation team. If you have the required skill and would like to explore opportunities with us, please send your detailed resume...

  • Lead Senior Developer

    4 weeks ago

    bangalore, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted content...

  • Lead Senior Developer

    1 month ago

    bangalore, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted content...

  • Senior/Lead/Principal Engineer

    3 months ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Hiring Java Engineer - Senior/Lead/Principal Engineer for US based Global Enterprise Product Consulting company for their Bangalore team.Experience : 5+ YearsLocation : BangaloreRole : Senior/ Lead/ PrincipalJob Description :- Experience: 5+ Years for Java Senior/ Lead / Principal Engineer.- Strong knowledge of Object Oriented analysis and design, software...

  • Senior/Lead/Principal Engineer

    4 weeks ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Hiring Java Engineer - Senior/Lead/Principal Engineer for US based Global Enterprise Product Consulting company for their Bangalore team.Experience : 5+ YearsLocation : BangaloreRole : Senior/ Lead/ PrincipalJob Description :- Experience: 5+ Years for Java Senior/ Lead / Principal Engineer.- Strong knowledge of Object Oriented analysis and design, software...

  • Senior/Lead/Principal Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Hiring Java Engineer - Senior/Lead/Principal Engineer for US based Global Enterprise Product Consulting company for their Bangalore team.Experience : 5+ YearsLocation : BangaloreRole : Senior/ Lead/ PrincipalJob Description :- Experience: 5+ Years for Java Senior/ Lead / Principal Engineer.- Strong knowledge of Object Oriented analysis and design, software...

  • Senior/Lead/Principal Engineer

    4 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Hiring Java Engineer - Senior/Lead/Principal Engineer for US based Global Enterprise Product Consulting company for their Bangalore team.Experience : 5+ YearsLocation : BangaloreRole : Senior/ Lead/ PrincipalJob Description :- Experience: 5+ Years for Java Senior/ Lead / Principal Engineer.- Strong knowledge of Object Oriented analysis and design, software...

  • IP Lead

    3 months ago

    bangalore, India Infosys Full time

    Role : IP Lead / Senior IP LeadLocation : BangaloreRequirements:B.E/B.Tech with More than 4 - 8 years’ experience in OSS compliance activities.Experience in Synopsys Detect / BlackDuck HUB and other SCA ToolsKnowledge in Open-source Licenses and Proprietary / 3rd party Terms and conditions.Responsible for training and guiding teams related to FOSS (Code...

  • Lead Senior Developer

    1 month ago

    bangalore, India Taylor & Francis Group Full time

    Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100. Taylor & Francis Group produces high quality, peer reviewed books and journals. We produce unique, trusted...

  • Lead Senior Developer

    1 month ago

    bangalore, India Taylor and Francis Full time

    Job DescriptionChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE ( suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research industries,...

  • Lead Senior Developer

    1 month ago

    bangalore, India Informa PLC Full time

    Job Description ChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research...

  • Lead Senior Developer

    4 weeks ago

    bangalore, India Taylor and Francis Full time

    Job DescriptionChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE ( suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research industries,...

  • Lead Senior Developer

    4 weeks ago

    bangalore, India Informa PLC Full time

    Job Description ChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and research...

  • Lead Senior Developer

    4 weeks ago

    bangalore, India Taylor & Francis Full time

    Job Description ChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and...

  • Lead Senior Developer

    1 month ago

    bangalore, India Taylor & Francis Full time

    Job Description ChemNetBase Lead Senior Developer Role The position for the Lead Senior Developer duties requires the development, management and support all 10 of the CHEMnetBASE () suite of products and authentication and customer management systems. CHEMnetBASE is a suite of 10 interactive databases mainly used in the academic and...

  • Senior Transformation Lead

    1 week ago

    bangalore, India Computacenter Full time

    Life on the teamWe are now looking for a Senior Transformation Lead, to join our Operational Excellence team. The Ops Excellence team are responsible for overseeing and driving the Remote Service Operations Governance, Quality and Continual Improvement agenda, ensuring successful and continuous business evolution, effectiveness, and control . This consists...

  • Senior Lead Governance

    4 weeks ago

    bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Senior Lead Governance Senior Lead Governance Req ID: Department: Initiatives and Delivery Cluster Division: Australia Retail Location: Bengaluru About Us Standard At ANZ, we're shaping a world where people and communities thrive, driven by a common goal: to improve the financial wellbeing and sustainability of our millions of customers. ...

  • Lead Senior Developer

    1 month ago

    Bengaluru/ Bangalore, India timesjobs Full time

    Lead Senior DeveloperFull-timeCompany DescriptionInforma is a leading academic publishing, business intelligence, knowledge, and events business, creating unique content and connectivity for customers all over the world. It is listed on the London Stock Exchange and is a member of the FTSE 100.Taylor & Francis Group produces high-quality, peer-reviewed books...