Senior Data Engineer
2 weeks ago
Key Responsibilities:
- Design and Develop Data Pipelines:
- Create and maintain data pipelines using Python, PySpark, and Spark SQL.
- Build Airflow DAG pipelines for seamless data ingestion and workflow automation.
- Data Management and Processing:
- Process large datasets using PySpark and DataFrames.
- Leverage your expertise in SQL for data extraction, transformation, and loading (ETL).
- Cloud Services and Architecture:
- Implement and maintain data solutions on AWS using services like S3, Glue, Redshift, Lambda, IAM, EMR, Athena, and Spectrum.
- Ensure data security, scalability, and cost-effectiveness within the AWS environment.
- Collaboration and Support:
- Work closely with application development teams to align data engineering solutions with business requirements.
- Lead a team of engineers in project delivery.
- Performance Optimization and Monitoring:
- Conduct performance tuning and optimization of SQL queries.
- Monitor and troubleshoot issues within data pipelines.
Requirements:
- 5-6 years of experience in data engineering or related fields.
- Proven track record of leading teams of at least 4 members.
- Experience working within agile development environments, collaborating with cross-functional teams.
At Alignity Solutions, we are looking for an expert in data engineering to join our team. As a Data Engineering Lead, you will leverage your experience in designing and developing data pipelines to ensure the successful delivery of data-driven solutions. Your strong background in business intelligence (BI) and data warehousing technologies will be essential in this role.
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India The Modern Data Company Full timeJob Title: Senior Analytics EngineerAt The Modern Data Company, we are seeking a highly skilled Senior Analytics Engineer to join our team. The ideal candidate will have a strong background in data engineering, architecture, and analytics, with a passion for designing and implementing scalable data solutions.Key Responsibilities:Provide technical expertise...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full timeA Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India The Modern Data Company Full timeJob Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeJob DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...
-
Digital Engineering Senior Software Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Digital Engineering Senior Software EngineerAbout the Role:We are seeking an experienced Digital Engineering Senior Software Engineer to join our team. As a key member of our digital transformation team, you will be responsible for leading the design, development, and implementation of cutting-edge digital solutions.Key Responsibilities:Lead the...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Digital Engineering Senior Software Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Senior Data Migration ConsultantWe are seeking an experienced Senior Data Migration Consultant to join our team at NTT DATA Services. As a Senior Data Migration Consultant, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities:12 years of experience in SAP Data...
-
Big Data Engineer, Data Modeling Expert
2 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Digital Engineering Senior Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Senior Syniti ADM ConsultantAbout the RoleWe are seeking an experienced Senior Syniti ADM Consultant to join our team. As a key member of our data migration team, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities12 years of experience in SAP Data Cleansing,...
-
Big Data Engineer, Data Modeling Expert
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India ValueLabs Full timeSenior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at ValueLabs. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes for our organization.Key Responsibilities:Data Pipeline Development: Design and develop data pipelines using ADF,...
-
Senior Digital Engineering Expert
4 days ago
Hyderabad, Telangana, India NTT DATA Full timeJob DescriptionReq ID: 295140 NTT DATA is seeking a talented individual to fill the role of Digital Engineering Senior Engineer. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, we encourage you to apply.We are currently seeking...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes in the AWS environment.Key Responsibilities:Design and develop scalable ETL processes to deliver meaningful...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines to extract, transform, and...
-
Senior Data Migration Developer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob DescriptionJob Title: Senior Data Migration DeveloperJob Summary: We are seeking a highly skilled Senior Data Migration Developer to join our team. The ideal candidate will have extensive experience in developing data migration tools, configuring LTMOM, and creating LSMW. They will also have hands-on experience with LTMOM, including creating custom...
-
Senior Data Migration Developer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data Migration Senior DeveloperAbout the Role:We are seeking a highly skilled Data Migration Senior Developer to join our team at NTT DATA Services. As a key member of our team, you will be responsible for developing and implementing data migration solutions using SAP technologies.Key Responsibilities:Develop and configure data migration tools...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Experian Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines using Spark and...