Data Engineer

Found in: Talent IN C2 - 2 weeks ago

Bengaluru, India aidetic Full time
AboutAideticWe are adynamic technology services startup that partners with cuttingedgeSaaS startups at the forefront of innovation in AI/ML CloudComputing and Digital Transformation. Our client base consists ofexciting SaaS startups hailing from the United States and Europe.Our primary objective is to accelerate innovation across variousindustries by collaborating with these forwardthinkingcompanies.(Visit to know more about thecompany.)
Aboutthe RoleAs a dataengineer you will be responsible for designing developing andmaintaining the architecture and infrastructure needed to manageand process large and complex data sets. You will work with datascientists and business stakeholders to understand their needs andrequirements and translate them into technical solutions that drivebusiness outcomes. You will build pipelines that collect storeprocess and analyze data ensuring its availability accuracy andsecurity.
Yearsof Experience3 5years
Responsibilities
  • Proficientin Cloud Data platforms and systems;
  • Developand maintain robust and scalable data pipelines using Pyspark orScala and Python;
  • Collaborate with crossfunctional teams to understand data requirements and transform theminto technical solutions;
  • Experience ( asdeveloper) in using DevOps processes inJenkins/Bitbucket/AzureDevOps;
  • Experence incatalogs like Hive Metastore OR Apache Atlas or UtilityCatalog;
  • Troubleshoot and resolve datarelatedissues ensuring data reliability andaccuracy;
  • Utilize Databricks to manage andorchestrate data workflows;
  • Experienc in Hadoopecosystem onprem (Cloudera) with SQL in Hadoop ecosystem will be anadded advantage;
  • Monitor and enhance datainfrastructure to meet evolving businessneeds;
  • Stay uptodate with the latest industrytrends and best practices to contribute to our data engineeringstrategy.


Qualifications(Musthaveskills)
  • Bachelorsdegree in Computer Science Information Technology or a relatedfield.
  • Proven experience as a Data Engineerwith a focus on Python SQL PySpark andDatabricks.
  • Strong proficiency in Python andSQL with the ability to write efficientcode.
  • Familiarity with Databricks and relatedcertifications will be preferred.
  • Solidunderstanding of data modeling ETL processes and datawarehousing.
  • Excellent problemsolving skillsand attention to detail.
  • Effectivecommunication and collaboration skills.
  • Abilityto work independently and as part of a team.
  • Apassion for data and a desire to continuously improve datainfrastructure.

SalaryThisrole comes with a market competitive salary which will remainaligned to your performance degree of professionalism cultural fitand alignment with Aidetic s longterm business strategy.
Benefits
  • StartupEnvironment: Join our small team of 50 young professionals in adynamic and impactful startup setting.
  • GrowthOpportunities: Expand your skills and advance your career rapidlyin our closeknit team where you can take on diverseresponsibilities.
  • Direct Impact: Yourcontributions shape the companys success and future growth makingyour work meaningful and recognized.
  • Fun andSocial Activities: Engage in regular teambuilding activities andevents fostering strong relationships withcolleagues.
  • Transparency and Communication:Experience a culture of transparency open communication andopportunities to providefeedback.
  • Entrepreneurial Spirit: Develop anentrepreneurial mindset and gain firsthand experience in building acompany.
  • Company Culture: Join a team thatcelebrates achievements supports one another and creates anenvironment for success.
  • Vacation and Holidays:Enjoy a generous vacation policy and holiday allowancesprioritizing your worklife balance andwellbeing.
  • Competitive Compensation: We offer ahighly competitive salary to attract top talent in the industry.Your hard work and contributions will be rewardedaccordingly.

python,sql,datamodeling,databricks,datawarehousing,pyspark,gcp,aws,azure,hive,datainfrastructure

  • Senior Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities: The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Talent IN 2A C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Data Modeler

    4 days ago

    Bengaluru, India Aptus Data LAbs Full time

    **Job Information**: Number of Positions - 1Industry - TechnologyWork Experience - 5-8 yearsLast Activity Time - 12/02/2021 23:00City - Bangalore NorthState/Province - KarnatakaCountry - IndiaZip/Postal Code - 560002The data modeller designs, implements, and documents data architecture and data modelling solutions, which include the use of relational,...

  • Aptus Data Labs

    Found in: Talent IN 2A C2 - 3 days ago

    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    Found in: Talent IN 2A C2 - 3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Senior Data Scientist

    Found in: Whatjobs IN C2 - 1 week ago

    Bengaluru, India Zen Data Shastra Full time

    Job description – Sr. Data ScientistThe candidate will have to leverage strong collaboration skills and the ability to extract valuable insights from highly complex data sets to ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500. The...

  • Senior Data Scientist

    Found in: Whatjobs IN C2 - 1 week ago

    Bengaluru, India Zen Data Shastra Full time

    Job description – Sr. Data Scientist The candidate will have to leverage strong collaboration skills and the ability to extract valuable insights from highly complex data sets to ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500. The...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Data Engineer

    Found in: Whatjobs IN C2 - 15 hours ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer, IN Data Engineering

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing...

  • Data Engineer

    Found in: Talent IN 2A C2 - 1 week ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 1 week ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Almighty HRD Consultants Full time

    Hi,We are seeking a highly skilled and experienced Data Engineer for our client located in Bangalore. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure and systems. This role offers an exciting opportunity to work with various data technologies and contribute to the success of our...

  • Data Engineer, IN Data Engineering

    Found in: Whatjobs IN C2 - 1 week ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Digital Engineering Lead Engineer

    Found in: Talent IN C2 - 2 weeks ago

    Bengaluru, India NTT DATA Full time

    • Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure). • Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions. • Hands-on experience in integrating event based or streaming data into...

  • Data Engineer, IN Data Engineering

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build analytics solutions and manage the largest petabyte-scale data infrastructure in India and for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelinesHands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimizationDesign, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Bengaluru, India Yara Full time

    ResponsibilitiesParticipate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams.Monitor, manage and maintain data pipelines as part of the day-to-day data operations.Build data mart tables for various use cases by working with the different data consumers...