Analytics - GCP Data Engineer - Python/Scala

1 week ago

Any Location, India Sigmoid Full time
This position will be part of a growing team working towards building world-class large scale Big Data architectures.

Responsibilities :

  • Good Development Practices
  • Handson coder with good experience in programming languages like Python or Scala.
  • Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment
  • Selfstarter to be able to grasp new concepts and technology and translate them into large scale engineering developments.
  • Excellent experience in Application development and support, integration development, and data management.
  • Align Sigmoid with key Client initiatives
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
  • Stay uptodate on the latest technology to ensure the greatest ROI for customer & Sigmoid
  • Hands on coder with good understanding on enterprise level code.
  • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment

Culture :

  • Must be a strategic thinker with the ability to think unconventional/out of box.
  • Analytical and solution driven orientation.
  • Raw intellect, talent and energy are critical.
  • Entrepreneurial and Agile : understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer".

Qualifications :
year track record of relevant work experience and a computer Science or a related technical discipline is required

  • Experience in development of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, and propose comprehensive solutions.
  • Experience with functional and objectoriented programming, Python is a must.
  • Hand-On knowledge in GCP DE Tech Stack, GKE, PySpark/Scala, BigQuery, Dataproc , Pubsub, Cloud Function, Cloud Composer, Dataflow etc.
  • Development and support experience in Big Data domain
  • Effective communication skills (both written and verbal)
  • Ability to collaborate with a diverse set of engineers, data scientists and product managers
  • Comfort in a fastpaced startup environment.

Skill Set :

Programming language :

Python, Scala , GKE, BigQuery, Dataproc, SPARK programming Pubsub, Cloud Function, Cloud Composer, Dataflow etc Terraform, CloudSQL and Postgres SQL.


  • SQL Programming
  • DSA(Data structure algorithm)
)

  • Sigmoid Analytics

    2 months ago

    Any Location, India Sigmoid Full time

    This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : - Good Development Practices - Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing,...

  • Senior Backend Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Backend Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...

  • Senior Backend Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...

  • Senior Backend Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Azure Databricks Developer

    2 months ago

    Any Location/Bangalore, IN KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...

  • Azure Databricks Developer

    3 weeks ago

    Any Location/Bangalore, India KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...

  • Azure Databricks Developer

    2 months ago

    Any Location/Bangalore, India KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...

  • Azure Databricks Developer

    3 weeks ago

    Any Location/Bangalore, IN KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...

  • Big Data Engineer

    1 week ago

    Any Location, IN Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

  • Data Engineer

    3 weeks ago

    Any Location, India Suitable.AI Full time

    Role : .Net Core you will do : - Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow. - Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards. - Actively monitor and triage technical...

  • Data Engineer

    3 weeks ago

    Any Location, IN Suitable.AI Full time

    Role : .Net Core you will do :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical challenges...

  • Data Engineer

    4 weeks ago

    Any Location, IN Suitable.AI Full time

    Role : .Net Core you will do :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical challenges...

  • Data Engineer

    1 month ago

    Any Location, India Suitable.AI Full time

    Role : .Net Core you will do : - Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow. - Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards. - Actively monitor and triage technical...

  • Senior Python Developer

    2 months ago

    Any Location, India Anni Solutions Full time

    Mandatory Skills Description:- Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms.- Good programming skills in Java, spring Boot, and Junit.- Knowledge in software development test approaches & and frameworks- Familiarity with RESTful APIs and micro-services architectures- Experience...

  • Data Engineer

    3 weeks ago

    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...