Senior Big Data Solutions Architect
2 weeks ago
We are a leading technology company, and we're looking for an experienced Cloud Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing, building, and maintaining scalable data pipelines and infrastructure to support data-driven initiatives.
Job Description:
We're seeking a highly skilled Cloud Data Engineer with expertise in designing and implementing robust data pipelines and ETL processes using Python, PySpark, and AWS Glue. Your primary focus will be on developing and maintaining data lake solutions that ensure scalability, security, and performance.
Key Responsibilities:
- Design and implement data pipelines using Python, PySpark, and AWS Glue
- Develop and maintain data lake solutions for efficient data storage and retrieval
- Implement data lineage and metadata management processes
- Collaborate with cross-functional teams to ensure data quality, availability, and accessibility
- Optimize data storage and retrieval for efficiency and cost-effectiveness using AWS Redshift and Snowflake
- Write, optimize, and maintain complex SQL queries for data retrieval and manipulation
- Ensure data quality through data validation, testing, and monitoring
- Implement data governance policies and procedures to ensure compliance and security
- Perform data analysis and troubleshooting to resolve data-related issues
- Design and develop data visualizations and dashboards to enable data-driven decision-making
Requirements:
- Proven work experience as a Cloud Data Engineer or similar role
- Strong proficiency in Python programming and experience with PySpark for big data processing
- Hands-on experience with AWS Redshift and SQL query writing (mandatory)
- Hands-on experience with other AWS services including Glue, S3, EMR, and Lambda
- Solid understanding of data lake architecture and design principles
- Experience with data lineage tools and metadata management
- Proficiency in SQL and database technologies (relational and non-relational databases) is mandatory
- Experience with data visualization tools such as Tableau, Power BI, or equivalent
- Strong analytical and problem-solving skills
- Excellent communication and teamwork skills
Preferred Skills:
- Master's degree in Computer Science, Data Engineering, Data Science, or a related field
- Certification in AWS or related cloud platforms
- Experience with DevOps practices and CI/CD pipelines
- Knowledge of machine learning concepts and frameworks
- Experience with Agile/Scrum methodologies
Compensation and Benefits:
The estimated annual salary for this position is ₹1,200,000 - ₹1,800,000 depending on your level of experience and qualifications. We also offer a comprehensive benefits package, including health insurance, retirement plan, and paid time off.
-
Senior Big Data Architect
2 days ago
Hyderabad, Telangana, India S P A Enterprise Full timeJob Title: Senior Big Data ArchitectAbout Us:S P A Enterprise is a leading organization in the industry, dedicated to delivering high-quality solutions and services. We are currently seeking an experienced Senior Big Data Architect to join our team.Salary: $140,000 - $180,000 per year, depending on experience.Job Description:We are looking for a highly...
-
Innovative Big Data Solutions Engineer
1 week ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Big Data Solutions Architect
1 week ago
Hyderabad, Telangana, India Tiger Analytics Full timeJob Title: Big Data Solutions ArchitectAbout Tiger Analytics: Tiger Analytics is a leading provider of data analytics solutions, dedicated to helping businesses make informed decisions.Salary: $180,000 - $250,000 per year.Job Description: We are seeking an experienced Big Data Solutions Architect to lead the design and implementation of scalable and...
-
Big Data Solutions Architect
1 week ago
Hyderabad, Telangana, India Tiger Analytics Full timeJob DescriptionWe are looking for a Senior Data Engineer to join our Tiger Analytics team based out of Chennai, Bangalore & Hyderabad offices.This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will design and build solutions for near real-time stream processing as well...
-
GCP Big Data Solutions Architect
2 weeks ago
Hyderabad, Telangana, India Tiger Analytics Full timeAbout Tiger Analytics:We are a forward-thinking analytics company that helps businesses make informed decisions through data-driven insights.As a Senior Data Engineer, you will be part of our team that designs and implements scalable data solutions on the Big Data platform.Our ideal candidate is a skilled professional with experience in designing and...
-
Big Data Solutions Engineer
1 week ago
Hyderabad, Telangana, India Epam Full timeEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities.We embrace a dynamic and inclusive culture where collaboration with multi-national teams is encouraged, and innovative projects are delivered that showcase the most...
-
Senior Data Platform Architect
1 week ago
Hyderabad, Telangana, India Tiger Analytics Full timeJob Title: Senior Data Platform ArchitectAbout the RoleTiger Analytics is seeking an experienced Cloud and Big Data Platform Architect to lead our data and analytics solutions. The ideal candidate will design, implement, and optimize scalable and resilient architectures for big data solutions using Databricks and AWS cloud environments.Key...
-
Hyderabad, Telangana, India NucleusTeq Consulting Pvt. Ltd. Full timeAbout NucleusTeq Consulting Pvt. Ltd.NucleusTeq is a global software services company that empowers businesses through digital innovation. Our portfolio includes Fortune 1000 clients and global partners, showcasing our ability to deliver world-class solutions.Job SummaryWe are seeking an experienced Senior Data Engineer to join our team in Hyderabad. This...
-
Senior Cloud Data Solutions Architect
1 week ago
Hyderabad, Telangana, India Programmers Full timeWe are seeking a highly skilled Senior Cloud Data Solutions Architect to join our team at Programmers. The ideal candidate will have extensive experience in designing and implementing data solutions on cloud platforms, including AWS, Azure, and Google Cloud.As a key member of our team, you will be responsible for leading the development of innovative data...
-
Data Architect
1 month ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full timeA Data Architect at NTT DATA Business Solutions plays a pivotal role in designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Key Responsibilities:Designing and Implementing ETL Processes:Develop scalable data pipelines and create efficient Extract, Transform, Load (ETL)...
-
Senior Data Architect
2 weeks ago
Hyderabad, Telangana, India INFEC Services Private Limited Full timeJob Title: Senior Data Architect/Data Engineering LeadWe are seeking a highly skilled and experienced Senior Data Architect/ Data Engineering Lead to join our team at INFEC Services Private Limited in Hyderabad.Job Type: Contract To Hire (6 months probation period)Estimated Salary: ₹1,200,000 - ₹1,800,000 per annumYears of Experience: 3-6 yearsWork...
-
Hyderabad, Telangana, India Tiger Analytics Full timeJob Title: Cloud Computing Data Governance Solutions ArchitectAbout the Role:We are seeking a highly skilled Senior Manager/Associate Director to lead our Data Governance team. The successful candidate will have extensive experience in cloud computing, big data solutions, and data governance.Key Responsibilities:Design, architect, deploy, and maintain big...
-
Senior Data Solutions Architect
5 days ago
Hyderabad, Telangana, India Inspire Full timeCompany OverviewInspire is a cutting-edge technology company that aims to revolutionize the data landscape. We are seeking a highly skilled Senior Data Solutions Architect to join our team.
-
Big Data Solutions Architect
6 days ago
Hyderabad, Telangana, India raptorX Full timeJob Title: Data EngineerAbout the Role:RaptorX is seeking an exceptional Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing scalable data management systems that support the integration and analysis of large datasets. You will work closely with data scientists and ML engineers...
-
Senior Scala Engineer for Big Data Solutions
2 weeks ago
Hyderabad, Telangana, India SPG Consulting Full timeWe are seeking a highly skilled Senior Scala Engineer to join our team at SPG Consulting, based in Kochi/BLR/HYD/Noida/BBSR/Gurgaon. The successful candidate will have 5+ years of experience in IT and a strong background in Spark and Scala.The ideal candidate will have experience with streaming systems like Spark Streaming and Storm, as well as expertise in...
-
Senior Big Data Developer
3 weeks ago
Hyderabad, Telangana, India US Technology International Pvt Ltd Full timeJob SummaryWe are seeking a highly skilled Senior Big Data Developer to join our team at US Technology International Pvt Ltd. As a Senior Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Spark/Scala.Key Responsibilities:Design and develop scalable data processing systems using...
-
Senior Data Architect
1 day ago
Hyderabad, Telangana, India CUPWINGS SYSTEMS PRIVATE LIMITED Full timeWe are seeking a highly skilled Senior Data Architect to join our team at CUPWINGS SYSTEMS PRIVATE LIMITED. With a strong background in data engineering and cloud computing, this individual will play a key role in designing and implementing scalable data pipelines and infrastructure to support data-driven initiatives.Key ResponsibilitiesDesign and implement...
-
Senior Big Data Architecture Lead
2 weeks ago
Hyderabad, Telangana, India Orbcomm Full timeTransformative Opportunity for a Senior Big Data Architecture LeadWe are seeking an exceptional individual to lead our big data architecture initiatives, driving innovation and excellence in our IoT technology solutions.About the Role:As a Senior Big Data Architecture Lead at ORBCOMM, you will be responsible for designing and developing scalable data...
-
Data Solutions Architect
4 weeks ago
Hyderabad, Telangana, India Tiger Analytics Full timeSenior Architect Role OverviewTiger Analytics, a global AI and analytics consulting firm, seeks a skilled Senior Architect to join its team. As a key member of our organization, you will play a crucial role in delivering comprehensive BI solutions that drive business success.The ideal candidate will have extensive experience in developing and maintaining...
-
Data Engineer for Large-Scale Big Data Solutions
2 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeWe are seeking an experienced data engineer to join our team at Alignity Solutions in Mumbai. The ideal candidate will have expertise in Apache Spark and Python programming, focusing on building scalable, high-performance data processing pipelines.Job Description:The role of a PySpark Developer involves developing, testing, and maintaining large-scale data...