Data Engineering Senior Specialist

4 days ago

PimpriChinchwad, Maharashtra, India Telstra Full time
Job TitleData Engineering Senior Specialist

Job Summary

As a Data Platform Engineer Senior Specialist, you bridge the hardware-software boundary. You create, optimise and maintain data storages and platforms so that our users can access high quality and reliable data assets and solutions. You play a key role in transforming epics into delivering new capability/product features for our customers.Job Description

Telstra is Australia's leading telecommunications and technology company with a rich heritage that's been built over 100 years. From our humble beginnings in the Postmaster General's Office to the global business we are today, our people have been at the forefront of technology innovation. We have the largest global networks in Australia and are the most well-known brand in technology and communications industry. We have operations in more than 20 countries, including in India. In India, we are a licensed Telecom Service provider and have extended our global networks into India with offices in Bangalore, Mumbai and Delhi. We've opened an Innovation and Capability Centre in Bangalore, and have a presence in Pune and Hyderabad. In India, we've set out to build a platform for innovative delivery and engagement that will strengthen our position as an industry leader. We're combining innovation, automation and technology to solve the world's biggest technological challenges in areas such as Internet of Things (IoT), 5G, Artificial Intelligence (AI), Machine Learning, and more.

We're growing, fast, and for you that means many exciting opportunities to develop your career at Telstra. You will be part of a team that focuses on extending our network superiority to enable the continued execution of our digital strategy. With us, you'll be working with world-leading technology and change the way we do IT to ensure business needs drive priorities, accelerating our digitisation programme. We are seeking a highly skilled Data Engineer with expertise in Spark, Python, Scala. The successful candidate will be responsible for designing, developing, and maintaining data pipelines using Spark, Python, Scala, and related technologies. The Data Engineer will also be responsible for ensuring data quality, data security, and optimal performance of the data pipelines. Any new engineer would be mostly into developing reusable data processing and storage frameworks that can be used across data platform.

Key Responsibilities

The Senior Data Engineer role is to coordinate, and execute all activities related to the requirements interpretation, design and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices to issues related to design, development, and deployment of mission-critical systems with a focus on quality application development and delivery.

The role is key to the success of the Data Engineering capability at Telstra and will be responsible and accountable for the following:

  • Lead the design, development, and maintenance of data pipelines using Spark, Python, Scala, and related technologies.
  • Work with high volume data and ensure data quality and accuracy.
  • Implement data security and privacy best practices to protect sensitive data.
  • Collaborate with data scientists and business stakeholders to understand data needs and requirements.
  • Develop and maintain documentation on data pipeline architecture, data models, and data workflows.
  • Mentor and provide technical guidance to junior team members.
  • Monitor and troubleshoot data pipelines to ensure they are performing optimally.
  • Stay up-to-date with the latest developments in Azure, AWS, Spark, Python, Scala, and related technologies and apply them to solve business problems.
  • Optimize data pipelines for cost and performance.
  • Automate data processing tasks and workflows to reduce manual intervention.
  • Ability to work in Agile Feature teams.
  • Provide training and educate other team members around core capabilities and helps them deliver high quality solutions and deliverables/documentation.
  • Self-Motivator to perform Design / Develop user requirements, test and deploy the changes into production.

Technical Skills

  • Hands-on experience in the following on Spark Core, Spark SQL, SQL/Hive/Impala.
  • Exposure on Hadoop Ecosystem(HDP/Cloudera/MapR/EMR etc).
  • Experience of working on File formats (Parquet/ORC/AVRO/Delta/Hudi etc.).
  • Experience with high volume data processing and data streaming technologies.
  • Experience of using Orchestration tools like Control-m,Azure Data Factory,Airflow,Luigi to schedule jobs.
  • Demonstrated experience leading data engineering projects and mentoring junior team members.
  • Data engineer with expertise of working on Azure Cloud using Databricks, Kinesis/ Azure Event hub Flume/Kafka/Spark streaming, Azure Data Factory.
  • Strong experience in data modeling, schema design, and ETL development using SQL and related technologies.
  • Familiarity with data security and privacy best practices.
  • Good exposure on TDD.
  • Exposure on using CI tools like Git, Bitbucket, Github, Gitlab, Azure DevOps.
  • Exposure on using CD tools like Jenkins, Bamboo, Azure DevOps.
  • Exposure on Observability tools like Azure Monitor, Graphana etc.
  • Prior experience in building or working in team building reusable frameworks.
  • Good understanding of Data Achitecture and design principles. (Delta/Kappa/Lambda architecture).
  • Exposure to Code Quality - Static and Dynamic code scans.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.
  • Should be able to provided scalable and robust solution architecture depending on the business needs.
  • Propose best practices/standards.
  • Programming & Databases - Java /Python/Scala/ SQL Procedure. Multi tenanted databases / Spark

  • Data Engineering Senior Specialist

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Telstra Full time

    About the RoleTelstra is seeking a highly skilled Data Engineer to join our team in Bangalore, Hyderabad, or Pune. As a Data Platform Engineer Senior Specialist, you will play a key role in transforming epics into delivering new capability/product features for our customers.You will be responsible for designing, developing, and maintaining data pipelines...

  • Senior Data Platform Specialist

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India Telstra Full time

    Job Title: Data Engineering Senior SpecialistAt Telstra, we're looking for a highly skilled Data Engineer to join our team. As a Data Engineer, you'll play a key role in bridging the hardware-software boundary, creating, optimising, and maintaining data storages and platforms. Your expertise in designing, developing, and maintaining data pipelines using...

  • Data Transformation Specialist

    2 weeks ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Data Transformation SpecialistN Consulting Ltd is seeking a skilled Data Transformation Specialist to join our team. As a key member of our data engineering team, you will be responsible for analyzing and modeling complex data structures and requirements.Key Responsibilities:Analyze and model complex data structures and requirementsDevelop and implement data...

  • Data Transformation Specialist

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Job Title: Data Transformation SpecialistN Consulting Ltd is seeking a skilled Data Transformation Specialist to join our team. The ideal candidate will have a strong background in data analysis and modeling, with experience in working with complex data structures and requirements.Key Responsibilities:Analyze and model complex data structures and...

  • Data Transformation Specialist

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Data Transformation SpecialistN Consulting Ltd is seeking a skilled Data Transformation Specialist to join our team. As a key member of our technical team, you will be responsible for analyzing and modeling complex data structures, as well as developing and implementing software solutions to meet business requirements.Key Responsibilities:Analyze and model...

  • Data Engineering Senior Specialist

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Telstra Full time

    About the RoleTelstra is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing, developing, and maintaining data pipelines using Spark, Python, Scala, and related technologies.You will work with high volume data and ensure data quality and accuracy. You will also implement data security and privacy...

  • Senior Optics Engineer

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India Magna Full time

    About MagnaWe are a global leader in the development and manufacturing of innovative automotive technologies, including advanced lighting systems. Our mission is to make vehicles safer, cleaner, and more connected, while serving our communities and the planet.The RoleWe are seeking a skilled Senior Optics Engineer to join our team. As a key member of our...

  • Senior Optics Engineer

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Magna Full time

    About MagnaMagna is a leading innovator in the development and manufacturing of automotive technologies, including seating structures, foam, and trim. We strive to create a future where everyone can live and move without limitations, and our team is dedicated to making vehicles safer and cleaner.About the RoleWe are seeking a Senior Optics Engineer to join...

  • Senior Mechanical Design Specialist

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India Executive81 HR Solutions Pvt. Ltd. Full time

    **Job Summary:**We are seeking a highly skilled Senior Mechanical Design Specialist to join our team at Executive81 HR Solutions Pvt. Ltd.Key Responsibilities:Design and develop mechanical systems and products using CATIA and 2D drafting tools.Collaborate with cross-functional teams to ensure design meets engineering and manufacturing requirements.Develop...

  • Senior Data Transformation Specialist

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Data Transformation Engineer RoleN Consulting Ltd is seeking a highly skilled Technical Data Analyst to join our team in the position of Data Transformation Engineer. The ideal candidate will have a strong background in IT, particularly in technical analysis, data modeling, and software engineering.Key Responsibilities:Analyze and model complex data...

  • Senior Optics Engineer

    4 days ago

    Pimpri-Chinchwad, Maharashtra, India Magna Full time

    About UsWe're a global leader in automotive technology, driving innovation and excellence in everything we do. At Magna, our mission is to create a safer, cleaner, and more connected world through our cutting-edge designs and solutions.Job SummaryWe're seeking an experienced Senior Optics Engineer to join our team. As a key member of our optics engineering...

  • Senior Optics Engineer

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Magna Full time

    About UsMagna is a leading innovator in the development and manufacturing of seating structures, foam, and trim for the global automotive, heavy truck, and bus industries. Our mission is to create a future where everyone can live and move without limitations.Job SummaryWe are seeking a Senior Optics Engineer to join our team. As a key member of our optical...

  • Product Design Specialist

    2 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Executive81 HR Solutions Pvt. Ltd. Full time

    Job Title: Product Design SpecialistAt Executive81 HR Solutions Pvt. Ltd., we are seeking a skilled Product Design Specialist to join our team. The ideal candidate will have a strong background in mechanical engineering and experience with CAD software.Key Responsibilities:Design and develop new engineering products and processesCraft detailed models and...

  • Data Transformation Specialist

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Data Transformation EngineerWe are seeking a highly skilled Data Transformation Engineer to join our team at N Consulting Ltd.Key Responsibilities:Design and implement data transformation solutions using various programming languages and technologies.Analyze and model complex data structures and requirements to ensure accurate and efficient data...

  • Data Engineering Developer

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India Telstra Full time

    Job TitleData Engineering DeveloperAbout the RoleWe are seeking a highly skilled Data Engineer with expertise in Spark, Python, and Scala to join our team at Telstra. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines using Spark, Python, Scala, and related technologies.Key ResponsibilitiesDesign, develop,...

  • Senior Software Engineer

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Crane India Full time

    Job Title: Senior Software EngineerCrane India is seeking a highly skilled Senior Software Engineer to join our team. As a key member of our software development team, you will be responsible for designing, developing, and testing software applications for aerospace and electronics markets.Key Responsibilities:Work collaboratively with cross-functional teams...

  • Mechanical Design Specialist

    1 week ago

    Pimpri-Chinchwad, Maharashtra, India Executive81 HR Solutions Pvt. Ltd. Full time

    About the RoleWe are seeking a skilled Mechanical Design Specialist to join our team at Executive81 HR Solution Pvt Ltd.The successful candidate will be responsible for designing new engineering products and processes, crafting models and drawings of products using CAD software, analyzing prototype data, researching new product ideas, and improving existing...

  • Data Transformation Engineer

    5 days ago

    Pimpri-Chinchwad, Maharashtra, India N Consulting Ltd Full time

    Data Transformation EngineerWe are seeking a highly skilled Data Transformation Engineer to join our team at N Consulting Ltd.About the Role:As a Data Transformation Engineer, you will be responsible for analyzing and modeling complex data structures and requirements.You will work closely with stakeholders to identify requirements and develop suitable...

  • Mechanical Design Specialist

    2 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Executive81 HR Solutions Pvt. Ltd. Full time

    At Executive81 HR Solutions Pvt. Ltd., we are seeking a skilled Mechanical Design Specialist to join our innovative team.The ideal candidate will have hands-on experience with CAD software, a strong attention to detail, and creative flair.Responsibilities include:Designing new engineering products and processesCrafting models and drawings of products using...

  • Data Engineering Developer

    3 weeks ago

    Pimpri-Chinchwad, Maharashtra, India Telstra Full time

    Job TitleData Engineering DeveloperJob SummaryTelstra is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines using Spark, Python, and related technologies. You will work with high volume data and ensure data quality and accuracy. You will also implement...