Data Engineer Position for Large-Scale Data Environments
20 hours ago
We are seeking a skilled Data Engineer to participate in the development lifecycle of applications related to document generation processing, printing, electronic and postal delivery. The successful candidate will work with various Lines of Business across the organization to understand their requirements and architecture to design and develop solutions that meet 100% Wells Fargo Technology SDLC compliance.
Key Responsibilities- ETL Design and Development: Develop, maintain, and optimize ETL processes for data ingestion, transformation, and data warehousing across multiple platforms, including SQL and NoSQL databases.
- Data Pipelines: Design, build, and manage scalable data pipelines using technologies like Databricks, Apache Spark, Python, SQL, and NoSQL databases.
- NoSQL/MongoDB Expertise: Work with MongoDB to design efficient document schemas, implement query optimization, and handle large-scale unstructured data.
- Data Integration: Collaborate with cross-functional teams to ensure seamless data integration between different sources such as databases (relational and NoSQL), APIs, and external files.
Essential Qualifications:
- Experience: Minimum of 5+ years of experience as a Data Engineer or ETL Developer in complex, large-scale data environments.
- SSIS, Databricks Expertise: Strong hands-on experience working with SSIS, Databricks, including using Apache Spark for data processing and optimization.
- Big Data Technologies: In-depth knowledge of big data processing frameworks like Spark, Hadoop, Kafka, etc.
- NoSQL/MongoDB: Expertise in working with NoSQL databases, especially MongoDB, for large-scale data storage, retrieval, and optimization.
The ideal candidate will have strong problem-solving skills, excellent communication, and the ability to work in a collaborative team environment. A solid understanding of legacy communication protocols and migration strategies is also essential.
Our team uses SSIS to transform mainframe formatted files to standard JSON and XML file format. We are targeting a migration from SSIS to Databricks. If you are an experienced Data Engineer looking for a challenging opportunity, please submit your application.
-
Data Engineer for Large-Scale Data Systems
2 weeks ago
Bengaluru, Karnataka, India PureSoftware Pvt Ltd. Full timeCompany OverviewPureSoftware Pvt Ltd. is a leading technology company that empowers businesses to drive innovation and growth through cutting-edge solutions.Job DescriptionWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and delivering large-scale...
-
Bengaluru, Karnataka, India myGwork Full timeJob Title: Data Engineer for Large Scale Data InfrastructureAbout the Role:This is an exciting opportunity to join Amazon Devices as a Data Engineer, working on big data related to Amazon's expanding portfolio of devices. The successful candidate will be part of the International Devices Data Services (IDDS) team, responsible for empowering business...
-
Large Scale Data Platform Specialist
4 hours ago
Bengaluru, Karnataka, India Anzyglobal Full timeWe are seeking a Senior Data Architect to join our team at Anzyglobal. As a Senior Data Architect, you will be responsible for designing, building, and maintaining large-scale data platforms and pipelines. The ideal candidate will have at least 5 years of experience in data engineering and a strong focus on large-scale data platforms and data products.You...
-
Bengaluru, Karnataka, India Talent500 Full timeTalent500 Seeks Data Engineer for Large-Scale AnalyticsEstimated salary range: $150,000 - $200,000 per year.About the Role:We are seeking an experienced Data Engineer to join our team at Talent500. As a key member of our analytics department, you will be responsible for designing and developing large-scale analytics solutions using Snowflake, dbt Cloud, and...
-
Bengaluru, Karnataka, India CygnusPro Software Solutions Pvt. Ltd Full timeEstimated salary: ₹30,00,000 - ₹40,00,000 per annumAbout CygnusPro Software Solutions Pvt. Ltd.We are a leading software solutions company that specializes in providing innovative data engineering services to our clients. Our team of experts is dedicated to delivering high-quality solutions that meet the evolving needs of businesses.Job Description:Data...
-
Bengaluru, Karnataka, India The Math Company Full timeJob Title : Cloud Data Engineer IIAt The Math Company, we are seeking an experienced Data Engineer to join our team. As a key member of our engineering department, you will be responsible for designing, storing, processing, and maintaining large-scale data and related infrastructure.We offer a competitive salary range of $140,000 - $180,000 per annum,...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India CodeVyasa Full timeLooking for a Senior Data Engineer to join our team in Bangalore. The ideal candidate should have at least 2+ years of experience in large-scale data processing and data pipeline development.We are a multinational software company, CodeVyasa, that is growing rapidly with offices in Florida and New Delhi. Our clientele spans across the US, Australia, and...
-
Snowflake Data Engineer and Architect
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...
-
Technical Lead, Large Scale Data Engineering
2 days ago
Bengaluru, Karnataka, India myGwork Full timeUnlock Career Advancement as a Technical Lead in Data EngineeringWe are seeking an exceptional Senior Software Development Engineer to join our Business Data Technologies team at Amazon. This role offers a unique opportunity to lead architecture initiatives in scaling, security, and availability while working with diverse user profiles and teams.About the...
-
Data Engineering Expert
2 weeks ago
Bengaluru, Karnataka, India McLaren Strategic Solutions (MSS) Full timeUnlock Your Potential as a Data Engineer with McLaren Strategic SolutionsAre you passionate about building efficient, large-scale data pipelines using distributed technologies like Hadoop and Spark? Do you have strong software engineering experience in Python, Scala, Java or equivalent?We are seeking an experienced Data Engineer to join our team at McLaren...
-
Data Engineer for Large Scale Data Solutions
2 days ago
Bengaluru, Karnataka, India LinkedIn Full timeAs a pioneer in professional networking, LinkedIn empowers members to achieve their career goals. Our mission is to create economic opportunities for the global workforce by providing innovative solutions that foster connections and drive growth. We strive to be a workplace where everyone feels valued and has the skills needed to succeed.The Data Science...
-
Data Engineer for Large-Scale Data Solutions
2 weeks ago
Bengaluru, Karnataka, India Observe Full timeObserve.AI: Boosting Contact Center Performance with Live Conversation IntelligenceAbout UsWe're the fastest way to enhance contact center performance, leveraging our cutting-edge AI engine. With Observe.AI, you'll uncover valuable insights from 100% of customer interactions and optimize frontline team performance through coaching and end-to-end workflow...
-
Bengaluru, Karnataka, India NTT DATA Services Full timeNTT DATA Services is seeking a highly skilled Integration and DevOps Expert to join our team in Bangalore, India. As a key member of our organization, you will be responsible for designing and implementing large-scale Java projects using Agile/Scrum methodologies.We offer a competitive salary of $120,000 per year, based on the national average for software...
-
Bengaluru, Karnataka, India Luxoft Full timeJob SummaryWe are seeking a Senior Data Ops Engineer to develop a scalable data collection, storage, and distribution platform. The ideal candidate will have expertise in Snowflake and AWS, as well as experience with web scraping, containerization, and DevOps.Key ResponsibilitiesDesign and implement large-scale data platforms using Snowflake and AWSDevelop...
-
Bengaluru, Karnataka, India Altimetrik Full timeAbout the RoleWe are seeking a skilled Data Engineer to join our team at Altimetrik in Bangalore. As a Data Engineer, you will play a critical role in designing and developing large-scale data warehousing solutions.ResponsibilitiesDesign and develop ETL jobs across multiple platforms using AWS services like S3, Redshift, EMR, Lambda, Athena, and Glue.Develop...
-
Bengaluru, Karnataka, India ANSR Full timeJob Overview">This role is responsible for designing and developing large-scale analytics solutions using data engineering principles. The ideal candidate will have a strong understanding of data architecture, solution design, and development best practices.
-
Bengaluru, Karnataka, India ADCI HYD 13 SEZ Full timeAbout UsADCI HYD 13 SEZ is a leading provider of innovative data solutions, enabling teams across Amazon to effectively manage and analyze massive datasets. Our mission is to empower businesses with cutting-edge technologies that simplify complex data challenges.Job DescriptionWe are seeking an experienced Sr. Software Development Engineer to join our team...
-
Data Architect for Large-Scale Analytics
3 weeks ago
Bengaluru, Karnataka, India Adobe Full timeUnlock the Power of Big DataWe're seeking a highly skilled Data Architect to join our team and lead the development of large-scale analytics platforms. With Adobe, you'll have the opportunity to work with cutting-edge technologies and collaborate with talented professionals to design and deliver exceptional digital experiences.About the RoleAs a Data...
-
Data Engineer for Large Scale Data Platforms
2 weeks ago
Bengaluru, Karnataka, India Microsoft Full timeMicrosoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of data...
-
Data Architect for Large-Scale Data Systems
2 weeks ago
Bengaluru, Karnataka, India NETSACH GLOBAL Full timeAbout the RoleWe are seeking an experienced Data Architect to join our team at Netsach Global, a leading Cyber Security Company. The ideal candidate will have a strong background in designing and developing large-scale data processing systems and architecture.Key ResponsibilitiesDesign, implement, and manage big data infrastructure and architecture to ensure...
