Data Engineering Senior Specialist
1 month ago
Closing Date 30 Dec 2023 11:59pm
Job Title Data Engineering Senior Specialist - Python & PysparkJob SummaryAs a Data Platform Engineer Senior Specialist, you bridge the hardware-software boundary.
You create, optimise and maintain data storages and platforms so that our users can access high quality and reliable data assets and solutions. You play a key role in transforming epics into delivering new capability/product features for our customers. Job Description
Telstra is Australia's leading telecommunications and technology company with a rich heritage that’s been built over 100 years. From our humble beginnings in the Postmaster General’s Office to the global business we are today our people have been at the forefront of technology innovation. More recently, we have the largest in Australia and are And this is just the beginning of what we’re hoping to achieve together.
We offer a full range of services and compete in all telecommunications markets throughout Australia and are the most well-known brand in technology and communications industry.We have operations in more than 20 countries, including in India. In India we are a licensed Telecom Service provider (TSP) and have extended our global networks into India with offices in Bangalore, Mumbai and Delhi. We’ve opened an Innovation and Capability Centre (ICC) in Bangalore, and have a presence in Pune and Hyderabad. In India, we’ve set out to build a platform for innovative delivery and engagement that will strengthen our position as an industry leader. We’re combining innovation, automation and technology to solve the world’s biggest technological challenges in areas such as Internet of Things (IoT), 5G, Artificial Intelligence (AI), Machine Learning, and more.
We’re growing, fast, and for you that means many exciting opportunities to develop your career at Telstra. Join us on this exciting journey, and together, we’ll reimagine the future.
Being part of Data Engineering means you'll be part of a team that focuses on extending our network superiority to enable the continued execution of our digital strategy. With us, you'll be working with world-leading technology and change the way we do IT to ensure business needs drive priorities, accelerating our digitisation programme.
We are seeking a highly skilled Data Engineer with expertise in Spark, Python, Scala. The successful candidate will be responsible for will be responsible for designing, developing, and maintaining data pipelines using Spark, Python, Scala, and related technologies. The Data Engineer will also be responsible for ensuring data quality, data security, and optimal performance of the data pipelines. Any new engineer would be mostly into developing reusable data processing and storage frameworks that can be used across data platform.
Hadoop Data Engineering – Hive, Oozie, Yarn / MapReduce, Spark (must) with SCALA (Pref) or Python, Strong SQL
Job Location
– Bangalore or Hyderabad or Pune.
Key ResponsibilitiesSenior Data Engineer role is to coordinate, and execute all activities related to the requirements interpretation, design and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices to issues related to design, development, and deployment of mission-critical systems with a focus on quality application development and delivery.This role is key to the success of the Data Engineering capability at Telstra and will be responsible and accountable for the following:
Lead the design, development, and maintenance of data pipelines using Spark, Python, Scala, and related technologies.Work with high volume data and ensure data quality and accuracyImplement data security and privacy best practices to protect sensitive dataCollaborate with data scientists and business stakeholders to understand data needs and requirementsDevelop and maintain documentation on data pipeline architecture, data models, and data workflowsMentor and provide technical guidance to junior team membersMonitor and troubleshoot data pipelines to ensure they are performing optimallyStay up-to-date with the latest developments in Azure, AWS, Spark, Python, Scala, and related technologies and apply them to solve business problemsOptimize data pipelines for cost and performanceAutomate data processing tasks and workflows to reduce manual intervention.Ability to work in Agile Feature teamsProvide training and educate other team members around core capabilities and helps them deliver high quality solutions and deliverables/documentationSelf-Motivator to perform Design / Develop user requirements, test and deploy the changes into productionTechnical SkillsHands-on experience in the following on Spark Core, Spark SQL, SQL/Hive/ImpalaExposure on Hadoop Ecosystem(HDP/Cloudera/MapR/EMR etc)Experience of working on File formats (Parquet/ORC/AVRO/Delta/Hudi etc.)Experience with high volume data processing and data streaming technologiesExperience of using Orchestration tools like Control-m,Azure Data Factory,Airflow,Luigi to schedule jobs.Demonstrated experience leading data engineering projects and mentoring junior team members.Data engineer with expertise of working on Azure Cloud using Databricks, Kinesis/ Azure Event hub Flume/Kafka/Spark streaming, Azure Data Factory.Strong experience in data modeling, schema design, and ETL development using SQL and related technologiesFamiliarity with data security and privacy best practicesGood exposure on TDDExposure on using CI tools like Git, Bitbucket, Github, Gitlab, Azure DevOpsExposure on using CD tools like Jenkins, Bamboo, Azure DevOpsExposure on Observability tools like Azure Monitor, Graphana etcPrior experience in building or working in team building reusable frameworksGood understanding of Data Achitecture and design principles. (Delta/Kappa/Lambda architecture)Exposure to Code Quality - Static and Dynamic code scansExperience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.Should be able to provided scalable and robust solution architecture depending on the business needs.Propose best practices/standardsProgramming & Databases - Java /Python/Scala/ SQL Procedure. Multi tenanted databases / Spark
-
Systems Integration Senior Specialist
22 hours ago
Hyderabad, India NTT DATA Full timeJob DescriptionReq ID:281059NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana (IN-TG), India...
-
Senior Specialist
1 month ago
Hyderabad, India LTIMindtree Full timeSenior Specialist - Software EngineeringJob Req Id: 1270403 Dot Net + Angular: 8 to 10 years of Angular Senior Developer with .NET Core Full Stack hands on experience.• Design and Development experience with C#, .Net Core API, SQL Server, JavaScript, jQuery, Bootstrap, Angular, Typescript, HTML5 etc.• Must Hands on Experience in Entity Framework• Good...
-
Senior Specialist
5 days ago
Hyderabad/ Secunderabad, India LTIMindtree Full timeApply for Senior Specialist Software Engineering, LTIMindtree Ltd. in Hyderabad/ Secunderabad for Year of Experience on
-
Systems Integration Senior Specialist
22 hours ago
Hyderabad, India NTT DATA Services Full timeReq ID:281059NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana (IN-TG), India (IN).We are looking...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India Swiss Re Full timeAbout the TeamJoin us as a core member of the Data Management team to develop and maintain modern data services for Swiss Re's international group of Risk Consulting specialists, who provide risk knowledge to Swiss Re clients around the world. About the RoleAs a Senior Data Engineer, you will contribute to and support data management activities using most...
-
Systems Integration Senior Specialist
2 days ago
Hyderabad, India NTT DATA Full timeJob Description Req ID: 281059 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana (IN-TG), India...
-
Systems Integration Senior Specialist
2 days ago
hyderabad, India NTT DATA Full timeJob Description Req ID: 281059 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana...
-
Systems Integration Senior Specialist
9 hours ago
hyderabad, India NTT DATA Full timeJob Description Req ID: 281059 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana...
-
Systems Integration Senior Specialist
22 hours ago
Hyderabad, India NTT DATA Full timeJob Description Req ID: 281059 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana (IN-TG), India...
-
Data Center Capacity Specialist
22 hours ago
Hyderabad, India NTT DATA Full timeJob DescriptionNTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...
-
Senior Specialist
1 month ago
Hyderabad, India LTIMindtree Full timeSenior Specialist - Software Engineering Job Req Id: 1270403 Dot Net + Angular:8 to 10 years of Angular Senior Developer with .NET Core Full Stack hands on experience.• Design and Development experience with C#, .Net Core API, SQL Server, JavaScript, jQuery, Bootstrap, Angular, Typescript, HTML5 etc.• Must Hands on Experience in Entity Framework•...
-
Senior Specialist
1 month ago
hyderabad, India LTIMindtree Full timeSenior Specialist - Software Engineering Job Req Id: 1270403 Dot Net + Angular:8 to 10 years of Angular Senior Developer with .NET Core Full Stack hands on experience. • Design and Development experience with C#, .Net Core API, SQL Server, JavaScript, jQuery, Bootstrap, Angular, Typescript, HTML5 etc. • Must Hands on Experience in Entity Framework...
-
Senior Enterprise Data Specialist
22 hours ago
Hyderabad, India F3328 FTIS (India) Pvt Ltd, FT Park Hyd Branch Full timeAt Franklin Templeton, we’re driving our industry forward by developing new and innovative ways to help our clients achieve their investment goals. Our dynamic and diversified firm spans asset management, wealth management, and fintech, offering many ways to help investors make progress toward their goals. Our talented teams working around the globe bring...
-
Data Engineer
2 days ago
hyderabad, India NTT DATA Full timeJob Description Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "Data...
-
Data Engineer
2 days ago
Hyderabad, India NTT DATA Full timeJob Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...
-
Data Engineer
1 day ago
hyderabad, India NTT DATA Full timeJob Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data...
-
Data Engineer
9 hours ago
hyderabad, India NTT DATA Full timeJob Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data...
-
Data Engineer
22 hours ago
Hyderabad, India NTT DATA Full timeJob Description Req ID: 280024 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...
-
Systems Integration Senior Specialist
2 days ago
hyderabad, India NTT DATA Services Full timeReq ID: 281059 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Senior Specialist to join our team in Hyderabad, Telangana (IN-TG), India (IN). We...
-
Data Center Capacity Specialist
2 days ago
hyderabad, India NTT DATA Full timeJob Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...
