Bigdata + Python + Aws

3 weeks ago


Bengaluru, India Black & White Business Solutions Full time

**Job Information**:
Industry

**IT Services**
***

Province

**Karnataka**
***

City

**Bangalore North**
***

Postal Code

**560001**
***

Country

**India**

Python + Bigdata Developer.

7+ years of development experience in the core tools and technologies like SQL, Python, AWS (Lambda, Glue, S3, Redshift, Athena, IAM Roles & Policies), PySpark used by the solution services team.
- Architect and build high-performance and scalable data pipelines adhering to data lakehouse, data warehouse & data marts standards for optimal storage, retrieval, and processing of data.
- 3+ years of experience in Agile Development and code deployment using Github & CI-CD pipelines.
- 2+ years of experience in job orchestration using Airflow.
- Expertise in the design, data modelling, creation, and management of large datasets/data models
- Ability to work with business owners to define key business requirements and convert to technical specifications
- Experience with security models and development on large data sets
Develop expertise of processes and data used by business functions within the US Affiliate
- Responsible for system testing, ensuring effective resolution of defects, timely discussion around business issues and appropriate management of resources relevant to data and integration
- Partner with and influence vendor resources on solution development to ensure understanding of data and technical direction for solutions as well as delivery

Job Location: Bangalore

Exp: 7 - 9 Years

Salary range: 3x into exp



  • Bengaluru, Karnataka, India Black & White Business Solutions Full time

    Job Information:IndustryIT Services***ProvinceKarnataka***CityBangalore North***Postal Code560001***CountryIndiaPython + Bigdata Developer.7+ years of development experience in the core tools and technologies like SQL, Python, AWS (Lambda, Glue, S3, Redshift, Athena, IAM Roles & Policies), PySpark used by the solution services team. Architect and build...

  • Data Developer

    7 days ago


    Bengaluru, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...

  • Sdet - Bigdata

    1 week ago


    Bengaluru, Karnataka, India Uptycs Full time

    Strong experience on testing Hadoop based Bigdata components running in a microservices environment.Strong programming skills in python is a must.Expertise in Kafka, Zookeeper, Postgres, Redis, Trino/impala, Http proxy etcExpertise in ETL, AWS, Kubernetes, databases, SQL and Linux.Expertise in Go, nodejs is a plus.Excellent troubleshooting skills and a...

  • Data Developer

    23 hours ago


    Bengaluru, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...

  • Data Developer

    7 days ago


    Bengaluru, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...


  • Bengaluru, Karnataka, India Learning Candid India Private Limited Full time

    Hiwe have job opportunity for ETL Bigdata platform tester position Years of Industry experience with 8+ years of DWH/ETL/ BI ( Both ETL and Report Testing Exp) Could experience AWS/Azure Big Data experience Good in writing complex SQL Good Communication Experience on preparing Test artefacts like test strategy, Test Plan, Test completion report, Good to...


  • Bengaluru, Karnataka, India Thomson Reuters Full time

    You are fit for the role of a Lead Software Engineer if your background includes: Applicant must have min 8 years of software engineering experience with exposure working on products/projects involving multiple integrations, data flows and complexity. **About the Role: - ** - Specialized in AWS(lambda, S3, Step Functions, EMR,Elastic), Java, Scala, Bigdata...

  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Bigdata + Pyspark

    1 week ago


    Bengaluru, Karnataka, India Impetus Technologies Full time

    BIgdata + Pyspark : Big Data; Hadoop / HDFS,Pyspark,Python Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...

  • Python, Pyspark

    1 week ago


    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • Bigdata Developer

    1 week ago


    Bengaluru, India Cloud Kinetics Technology Solutions Private Ltd Full time

    Job DescriptionJob Description: We are seeking a talented and enthusiastic Big Data Developer to join our dynamic team. The ideal candidate will have a strong foundation in Big Data technologies, particularly Hadoop, Hive, Scala,Python,Pyspark and Spark. As a Big Data Developer, you will be responsible for supporting the development and maintenance of our...

  • Aws Jd

    3 weeks ago


    Bengaluru, India Elfonze Technologies Full time

    **Job Information**: Industry - IT ServicesCity - Bangalore NorthState/Province - KarnatakaCountry - IndiaZip/Postal Code - 560001**IM3 - Offshore** - Experience and knowledge in setting up and management of AWS data related services (RedShift, EMR, Athena, S3, Sagemaker, Glue, Airflow, etc) - Experience and knowledge in setting up and management of AWS...

  • BigData Engineer

    3 weeks ago


    Bengaluru, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems...


  • Bengaluru, Karnataka, India Impetus Technologies Full time

    Having minimum 5 years of experiec in Java/J2EE and BigData technoloigesExperience in working on Hadoop Distribution, good understanding of core concepts and best practicesgood experience in building/tuning Spark pipelines in Scala/PythonGood experience in writing complex Hive queries to derive business critical insightsGood Programming experience with...


  • Bengaluru, India Impetus Technologies Full time

    Having minimum 5 years of experiec in Java/J2EE and BigData technoloigesExperience in working on Hadoop Distribution, good understanding of core concepts and best practicesgood experience in building/tuning Spark pipelines in Scala/PythonGood experience in writing complex Hive queries to derive business critical insightsGood Programming experience with...

  • Bigdata

    3 weeks ago


    Bengaluru, India CGI Full time

    Data Engineer with 5 to 7 years hands on experience for client Bell **Required Primary Skills**: Apache Spark, BigData Hadoop, Kafka, Sqoop, Cloudera manager, Python, Scala Secondary Skill HIVE, YARN Insights you can act on While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business...


  • Bengaluru, India Impetus Technologies Full time

    Having minimum 5 years of experiec in Java/J2EE and BigData technoloiges Experience in working on Hadoop Distribution, good understanding of core concepts and best practicesgood experience in building/tuning Spark pipelines in Scala/PythonGood experience in writing complex Hive queries to derive business critical insightsGood Programming experience with...

  • Bigdata Tester

    3 weeks ago


    Bengaluru, Karnataka, India CGI Full time

    Job Title: Bigdata tester Position: Software Engineer Experience: 4- 7 Years Category: Software Development/ Engineering Main location: India, Karnataka, Bangalore Position ID: J0224-0741 Employment Type: Full Time We are looking for an experienced Bigdata tester to join our team. You will work closely with our other members of the team to deliver quality...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Skill: Bigdata+ JavaSpark Developer Location- All locations (Pune, Mumbai, Chennai, Bangalore, Hyderabad, Coimbatore, Kolkata, Noida) Notice Period – 0 to 45 Days Exp- 4 to 13 Years • Strong experience in ETL development with Java & Spark • Strong experience with Redshift, AWS S3, SQL • Experience in developing microservices • Proficiency with...

  • Gcp + Bigdata

    1 month ago


    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata. Expereince- 5 to 12 years Location- Gurgaon & Bangalore • Must Have Qualifications: o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent. o Deep understanding of Hadoop and Spark Architecture...