Senior Data Engineer/Architect
2 weeks ago
As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, audit, and improve systems to meet particular needs, often as advised by a systems analyst or architect, testing both hard and software systems to diagnose and resolve system faults. The role also covers writing diagnostic programs and designing and writing code for operating systems and software to ensure efficiency. When required, you will make recommendations for future developments Benefits of Joining UsChallenging Projects : Work on cutting-edge projects and solve complex technical problems.Career Growth : Advance your career quickly and take on leadership roles.Mentorship : Learn from experienced mentors and industry experts.Global Opportunities : Work with clients from around the world and gain international experience.Competitive Compensation : Receive attractive compensation packages and benefits.If you're passionate about technology and want to work on challenging projects with a talented team, becoming an Infosys Power Programmer could be a great career choice.Mandatory SkillsAWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functionsExperience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern.Experience in designing and building data pipelines.Development experience in one or more object-oriented programming languages, preferably PythonJob Specs5+ years of in depth hands on experience of developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop PlatformIn depth knowledge of Spark Core, working with RDDs, Spark SQLIn depth knowledge on Spark Optimization Techniques and Best practicesGood Knowledge of Scala Functional Programming: Try, Option, Future, CollectionsGood Knowledge of Scala OOPS: Classes, Traits and Objects (Singleton and Companion), Case ClassesGood Understanding of Scala Language Features: Type System, Implicit/GivensHands on experience of working in Hadoop Environment (HDFS/Hive), AWS S3, EMRPython programming skillsWorking experience on Workflow Orchestration tools like Airflow, OozieWorking with API calls in ScalaUnderstanding and exposure to file formats such as Apache AVRO, Parquet, JSONGood to have knowledge of Protocol Buffers and Geospatial data analytics.Writing Test cases using frameworks such as scalatest.Good Knowledge of Build Tools such as: Gradle & SBT in depthExperience on using GIT, resolving conflicts, working with branches.Good to have worked on some workflow systems as AirflowStrong programming skills using data structures and algorithms.Excellent analytical skillsGood communication skills Qualification7-10 Yrs in the industryBE/B.tech CS or equivalent
-
Senior Data Architect
2 weeks ago
bangalore, India Sopra Steria Full timePosition: Senior Data Architect Experience: 14+ years Location: Bangalore/ Noida Education: B.E./ B.Tech./ MCA Primary Skills: MDM, Data Architecture, Data Modelling, Data Catalogue, Data Governance, Data Quality, DWH Role Overview: xperienced Data Architect to design and develop comprehensive enterprise data architecture that enables scalability,...
-
Senior Data Architect
2 weeks ago
Bangalore, India Sopra Steria Full timePosition: Senior Data Architect Experience: 14+ years Location: Bangalore/ Noida Education: B.E./ B.Tech./ MCA Primary Skills: MDM, Data Architecture, Data Modelling, Data Catalogue, Data Governance, Data Quality, DWH Role Overview: xperienced Data Architect to design and develop comprehensive enterprise data architecture that enables scalability,...
-
Senior Data Architect
2 weeks ago
bangalore, India Sopra Steria Full timePosition: Senior Data ArchitectExperience: 14+ yearsLocation: Bangalore/ NoidaEducation: B.E./ B.Tech./ MCAPrimary Skills: MDM, Data Architecture, Data Modelling, Data Catalogue, Data Governance, Data Quality, DWHRole Overview:xperienced Data Architect to design and develop comprehensive enterprise data architecture that enables scalability, governance, and...
-
Senior Data Architect
2 weeks ago
bangalore, India Tredence Inc. Full timeDesignation: Senior Manager (Databricks Architect)Location: Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad.Profile Summary: We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover...
-
Staff Engineer
1 day ago
Bangalore, India Wayfair Full timeStaff Engineer - Data Platforms- Software Engineering Wayfair is seeking a passionate and driven Staff Engineer to join our “Data Platforms” team. In this pivotal role, you will be instrumental in shaping and executing Wayfair’s New-Age Data Platform strategy across large-scale Data Ingestion, Transformation, Real-time Messaging Platforms and Data...
-
Senior Data Architect
2 days ago
bangalore, India Chevron Full timeTotal Number of Openings1About the position:Senior Data architects lead the design and implementation of data collection, storage, transformation, orchestration (movement) and consumption to achieve optimum value from data. They are the technical leaders within data delivery teams. They play a key role in modeling data for optimal reuse, interoperability,...
-
Senior Data Architect
3 weeks ago
bangalore, India Spectral Consultants Full timeWe’re Hiring | Data Architect / Senior Data Architect (Azure + Databricks) Locations: Chennai | Bangalore | Hyderabad Experience: 9–16 Years | Hybrid Work Model Role Overview As a Data Architect / Senior Data Architect , you’ll lead the design, development, and delivery of cutting-edge data platforms leveraging Azure, Databricks, and GenAI technologies...
-
Senior Azure Data Engineer/Lead
1 week ago
bangalore, India Ekfrazo Technologies Private Limited Full timeRole: Senior Data Engineer/LeadLocation : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days )Position 1 - Job Details – Data Engineer LeadExperience – 8 – 12 yrs - Data Engineer LeadKey skills : Databricks + SQL combination is mustThe Azure Data Engineer (Lead) is a management-level role...
-
Staff Engineer
1 day ago
Bangalore, India Wayfair Full timeStaff Engineer - Data Platforms- Software Engineering Who we are Wayfair is seeking a passionate and driven Staff Engineer to join our “Data Platforms” team. In this pivotal role, you will be instrumental in shaping and executing Wayfair’s New-Age Data Platform strategy across large-scale Data Ingestion, Transformation, Real-time Messaging Platforms...
-
Staff Engineer
2 days ago
bangalore, India Wayfair Full timeStaff Engineer - Data Platforms- Software Engineering Who we areWayfair is seeking a passionate and driven Staff Engineer to join our “Data Platforms” team. In this pivotal role, you will be instrumental in shaping and executing Wayfair’s New-Age Data Platform strategy across large-scale Data Ingestion, Transformation, Real-time Messaging Platforms and...
