Senior Data Engineer/Architect

2 days ago

Bangalore Division, India Infosys Full time

As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, audit, and improve systems to meet particular needs, often as advised by a systems analyst or architect, testing both hard and software systems to diagnose and resolve system faults. The role also covers writing diagnostic programs and designing and writing code for operating systems and software to ensure efficiency. When required, you will make recommendations for future developments Benefits of Joining Us Challenging Projects : Work on cutting-edge projects and solve complex technical problems. Career Growth : Advance your career quickly and take on leadership roles. Mentorship : Learn from experienced mentors and industry experts. Global Opportunities : Work with clients from around the world and gain international experience. Competitive Compensation : Receive attractive compensation packages and benefits. If you're passionate about technology and want to work on challenging projects with a talented team, becoming an Infosys Power Programmer could be a great career choice. Mandatory Skills AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern. Experience in designing and building data pipelines. Development experience in one or more object-oriented programming languages, preferably Python Job Specs 5+ years of in depth hands on experience of developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop Platform In depth knowledge of Spark Core, working with RDDs, Spark SQL In depth knowledge on Spark Optimization Techniques and Best practices Good Knowledge of Scala Functional Programming: Try, Option, Future, Collections Good Knowledge of Scala OOPS: Classes, Traits and Objects (Singleton and Companion), Case Classes Good Understanding of Scala Language Features: Type System, Implicit/Givens Hands on experience of working in Hadoop Environment (HDFS/Hive), AWS S3, EMR Python programming skills Working experience on Workflow Orchestration tools like Airflow, Oozie Working with API calls in Scala Understanding and exposure to file formats such as Apache AVRO, Parquet, JSON Good to have knowledge of Protocol Buffers and Geospatial data analytics. Writing Test cases using frameworks such as scalatest. Good Knowledge of Build Tools such as: Gradle & SBT in depth Experience on using GIT, resolving conflicts, working with branches. Good to have worked on some workflow systems as Airflow Strong programming skills using data structures and algorithms. Excellent analytical skills Good communication skills Qualification 7-10 Yrs in the industry BE/B.tech CS or equivalent

  • Senior Data Engineer

    2 weeks ago

    Bangalore Division, India USEReady Full time

    Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Staff Engineer

    4 hours ago

    Bangalore Division, India Wayfair Full time

    Staff Engineer - Data Platforms- Software Engineering Who we are Wayfair is seeking a passionate and driven Staff Engineer to join our “Data Platforms” team. In this pivotal role, you will be instrumental in shaping and executing Wayfair’s New-Age Data Platform strategy across large-scale Data Ingestion, Transformation, Real-time Messaging Platforms...

  • Senior Data Engineer

    4 hours ago

    Bangalore Division, India Elements HR Services Pvt Ltd Full time

    Senior Data Engineer Title Senior Data Engineer Department ISS Location Bengaluru Reports To Data Engineers – Lead Level 4,5,6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business...

  • Senior Architect

    1 week ago

    Bangalore Division, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will...

  • Senior Data Engineer

    1 week ago

    Bangalore Division, India Sonata Software Full time

    Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the...

  • Senior Data Architect

    2 days ago

    Bangalore Division, India Saaki Argus & Averil Consulting Full time

    About the company: An IT Service Management Company. Key Responsibilities: Create and put into action solid data architectures that facilitate business needs and promote data-driven decision-making. Using Snowflake, Databricks, Hadoop, and open-source data lake architectures, create and manage scalable data models, data warehouses, and data lakes. Oversee...

  • Data Architect

    2 weeks ago

    Bangalore Division, India Best Infosystems Ltd. Full time

    Data Architect_Full-Time_Trivandrum/Bangalore/Chennai/Kochi Job Title: Data Architect Job Type: Full-Time Location: Trivandrum/Bangalore/Chennai/Kochi Exp: 10+ years Job Description: •Design and implement scalable, secure, and cost-effective data architectures using GCP. •Lead the design and development of data pipelines with BigQuery, Dataflow, and...

  • Data Architect

    4 days ago

    Bangalore Division, India Quantiphi Full time

    Role: Architect - Data Experience Level: 8 Years and above Work location: Bangalore, Mumbai OR Trivandrum (Hybrid) What you’ll do: You will be working as a Data architect designing and delivering big data pipelines for structured and unstructured data that are running across multiple geographies, helping organizations achieve their business goals with use...

  • Data Architect

    2 weeks ago

    Bangalore Division, India Persistent Systems Full time

    About Position: We are looking for an experienced and talented Data Architect to join our growing data engineering team. The ideal candidate will have a strong background in working with Python, Pyspark, AWS/Databricks, ETL. Role: Data Architect Location: Bangalore Experience: 8 to 15 years Job Type: Full Time Employment What You'll Do: Data Architect with 8...

  • Associate Architect: Data

    4 hours ago

    Bangalore Division, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...