Senior Data Engineer
3 weeks ago
Location: Kolkata, Mumbai, Hyderabad
Experience: 6-10 Years
Job Description:
We are seeking a highly skilled Senior Data Engineer with expertise in Python Pyspark to join our team at Tata Consultancy Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Spark and Python.
Key Responsibilities:
- Design and develop scalable data processing systems using Spark and Python.
- Develop and maintain complex data pipelines using Pyspark.
- Collaborate with cross-functional teams to integrate data processing systems with other applications.
- Optimize data processing systems for performance and scalability.
- Develop and maintain unit tests and integration tests for data processing systems.
Requirements:
- Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.
- Experience in data processing and manipulation using Spark transformations and actions.
- Knowledge of Spark architecture and optimization techniques for performance tuning.
- Competence in programming languages such as Scala, Python, or Java for Spark development.
- Experience in working with big data technologies and distributed computing environments.
- Strong problem-solving skills and the ability to troubleshoot issues in Spark applications.
- Proficiency in version control systems like Git for collaborative development.
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India The Modern Data Company Full timeJob Title: Senior Analytics EngineerAt The Modern Data Company, we are seeking a highly skilled Senior Analytics Engineer to join our team. The ideal candidate will have a strong background in data engineering, architecture, and analytics, with a passion for designing and implementing scalable data solutions.Key Responsibilities:Provide technical expertise...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full timeA Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India The Modern Data Company Full timeJob Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeJob DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...
-
Digital Engineering Senior Software Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Digital Engineering Senior Software EngineerAbout the Role:We are seeking an experienced Digital Engineering Senior Software Engineer to join our team. As a key member of our digital transformation team, you will be responsible for leading the design, development, and implementation of cutting-edge digital solutions.Key Responsibilities:Lead the...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Digital Engineering Senior Software Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Senior Data Migration ConsultantWe are seeking an experienced Senior Data Migration Consultant to join our team at NTT DATA Services. As a Senior Data Migration Consultant, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities:12 years of experience in SAP Data...
-
Big Data Engineer, Data Modeling Expert
2 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Digital Engineering Senior Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Senior Syniti ADM ConsultantAbout the RoleWe are seeking an experienced Senior Syniti ADM Consultant to join our team. As a key member of our data migration team, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities12 years of experience in SAP Data Cleansing,...
-
Big Data Engineer, Data Modeling Expert
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India ValueLabs Full timeSenior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at ValueLabs. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes for our organization.Key Responsibilities:Data Pipeline Development: Design and develop data pipelines using ADF,...
-
Senior Digital Engineering Expert
4 days ago
Hyderabad, Telangana, India NTT DATA Full timeJob DescriptionReq ID: 295140 NTT DATA is seeking a talented individual to fill the role of Digital Engineering Senior Engineer. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, we encourage you to apply.We are currently seeking...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes in the AWS environment.Key Responsibilities:Design and develop scalable ETL processes to deliver meaningful...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines to extract, transform, and...
-
Senior Data Migration Developer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob DescriptionJob Title: Senior Data Migration DeveloperJob Summary: We are seeking a highly skilled Senior Data Migration Developer to join our team. The ideal candidate will have extensive experience in developing data migration tools, configuring LTMOM, and creating LSMW. They will also have hands-on experience with LTMOM, including creating custom...
-
Senior Data Migration Developer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data Migration Senior DeveloperAbout the Role:We are seeking a highly skilled Data Migration Senior Developer to join our team at NTT DATA Services. As a key member of our team, you will be responsible for developing and implementing data migration solutions using SAP technologies.Key Responsibilities:Develop and configure data migration tools...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines using Spark and...