Data Engineer(Python, Databricks, SQL, AWS)

2 weeks ago

Bengaluru, Karnataka, India Gainwell Technologies LLC Full time ₹ 12,00,000 - ₹ 24,00,000 per year
Summary

We are looking for a Data Engineer role. This role is strictly involved in the development of the product and does not involve access to Protected Health Information (PHI) & Personally Identifiable Information (PII) or any secured/confidential client data. The work is limited to application development & demo and does not include handling or processing of sensitive health information.

Your role in our mission
  • Design, develop and deploy pipelines including ETL-processes using Apache Spark Framework.
  • Monitor, manage, validate, and synthetic test data extraction, movement, transformation, loading, normalization, cleansing and updating processes in product development.
  • Coordinates with the stakeholders to understand the needs and delivery with a focus on quality, reuse, consistency, and security.
  • Collaborate with team-members on various models and schemas.
  • Collaborate with team-members on documenting source-to-target mapping.
  • Conceptualize and visualize frameworks
  • Communicate effectively with various stakeholders.
What we're looking for
  • Bachelor's degree in computer sciences or related field
  • 3 years of relevant experience and equivalent education in ETL Processing/data architecture or equivalent.
  • 3+ years of experience working with big data technologies on AWS/Azure/GCP
  • 2+ years of experience in the Apache Spark/DataBricks framework (Python/Scala)
  • Databricks and AWS developer/architect certifications a big plus
  • Strong project planning and estimating skills related to area of expertise
  • Strong communication skills
  • Good leadership skills to guide and mentor the work of less experienced personnel
  • Ability to be a high-impact player on multiple simultaneous engagements
  • Ability to think strategically, balancing long and short-term priorities
What you should expect in this role
  • Fast-paced, challenging and rewarding work environment.
  • Work life balance.
  • Remote working.
  • Will required late evening work to overlap US work hours, whenever it is required.

  • Sr. Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GAQ126R127As aSenior Data Engineerin the IT team, you will work on variousbig data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data.The Impact You Will...

  • Aws Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Citiustech Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Mandatory Skills - AWS , PySpark, Databricks, , Terraform, AngularDesired Skills - ETL, Python, SQLExperience - 3 years - 5 yearsLocation - Pune / Mumbai / Chennai / BangaloreStrong experience in Python, PySpark, and SQL Angular for front-end developmentExperience with AWS services (S3, CloudWatch, IAM, SNS, Lambda) Terraform knowledgeExperience with Git,...

  • Databricks AWS DE Analyst

    7 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 1+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data...

  • Databricks AWS DE Consultant

    4 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Mandatory SkillsBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 5+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and...

  • Databricks Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Astellas Pharma Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    As part of the Astellas commitment to delivering value for our patients, our organisation is currently undergoing transformation to achieve this critical goal. This is an opportunity to work on digital transformation and make a real impact within a company dedicated to improving lives.DigitalX our new information technology function is spearheading this...

  • Databricks Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astellas Pharma Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As part of the Astellas commitment to delivering value for our patients, our organisation is currently undergoing transformation to achieve this critical goal. This is an opportunity to work on digital transformation and make a real impact within a company dedicated to improving lives.DigitalX our new information technology function is spearheading this...

  • Aws Data Engineer

    4 days ago

    Bengaluru, Karnataka, India BriskWin IT (BWIT) Full time ₹ 4,00,00,000 - ₹ 8,00,00,000 per year

    AWS Data EngineerDatabricks exp is very much mandatory with AWS services.Work Location - RemoteNotice Period: Immediate Joiner apply onlyExperience: 6years - 12yearsMust Have:5+ years of experience building and managing Data Lake Architecture on AWS Cloud3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS,...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    P-1405At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Databricks + Pyspark + SQL

    2 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job description:Role: Databricks + Pyspark + SQLYear of Experience:4-8 YearsResponsibilities:Collaborate with cross-functional teams to understand data requirements and design efficient data processing solutions.Develop and maintain ETL processes using Databricks and PySpark for large-scale data processing.Optimize and tune existing data pipelines to ensure...

  • AWS Databricks Engineer

    4 days ago

    Bengaluru, Karnataka, India Changeleaders Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Looking for candidate having experience in AWS, Databricks ,Python, Pyspark.