SatSure - Data Engineer II - Data Pipeline

1 month ago


Bangalore, Karnataka, India SatSure Full time

Job Description :


As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively.

You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is collected, processed, stored, and analyzed efficiently and accurately.

Key Responsibilities :

- Data Pipeline Development: Design and implement robust data pipelines to acquire, ingest, clean, transform, and process geospatial data from various sources such as satellites, aerial, drones, and geolocation services.

- Data Ingestion, Storage and Extraction: Develop data models and schemas tailored to geospatial data structures, ensuring optimal performance and scalability for storage and retrieval operations.

- Spatial Database Management: Manage geospatial databases, including both traditional relational databases (e.g., PostgreSQL with PostGIS extension) and NoSQL databases (e. g. , MongoDB, Cassandra) to store and query spatial data efficiently.

- Geospatial Analysis Tools Integration: Integrate geospatial analysis tools and libraries (e.g., GDAL, GeoPandas, Fiona) into data processing pipelines and analytics workflows to perform spatial data analysis, visualization, and geoprocessing tasks.


- Geospatial Data Visualization: Collaborate with data visualization specialists to create interactive maps, dashboards, and visualizations that effectively communicate geospatial insights and patterns to stakeholders.

- Performance Optimization: Identify and address performance bottlenecks in data processing and storage systems, leveraging techniques such as indexing, partitioning, and parallelization to optimize geospatial data workflows.

- Data Quality Assurance: Implement data quality checks and validation procedures to ensure the accuracy, completeness, and consistency of geospatial data throughout the data lifecycle.

- Geospatial Data Governance: Establish data governance policies and standards specific to geospatial data, including metadata management, data privacy, and compliance with geospatial regulations and standards (e. g. , INSPIRE, OGC).

- Collaboration and Communication: Collaborate with cross-functional teams to understand geospatial data requirements and provide technical expertise and support.

- Communicate findings, insights, and technical solutions effectively to both technical and non-technical stakeholders.

Experience :

Must-have :

- Bachelor's or Master's degree in Computer Science or a related field.

- 3-5 yrs of experience working in the field and deploying the pipelines in production.

- Strong programming skills in languages such as Python, Java, or Scala, with experience in geospatial libraries and frameworks (e.g., GeoTools, Shapely).

- Experience with distributed computing frameworks (e.g., Apache Spark) and cloud-based data platforms (e.g., AWS, Azure, Google Cloud Platform).

- Familiarity with geospatial data formats and standards (e.g., GeoJSON, Shapefile, KML) and geospatial data visualization tools (e.g., Mapbox, Leaflet, Tableau).

- Strong analytical and problem-solving skills, with the ability to work with large and complex geospatial datasets.

Good-to-have :

- Proficiency in SQL and experience with geospatial extensions for relational databases (e. g., PostGIS).

- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

- Nice to have experience with geospatial libraries such as Rasterio, Xarray, Geopandas, and GDAL.

- Nice to have Knowledge of distributed computing frameworks such as Dask.

(ref:hirist.tech)

  • Bangalore, Karnataka, India SatSure Full time

    About SatSure :SatSure is a deep tech, decision Intelligence company that works primarily at the nexus of agriculture, infrastructure, and climate action creating an impact for the other millions, focusing on the developing world. We want to make insights from earth observation data accessible to all.SatSure is seeking a Senior Software Development Engineer...


  • Bangalore, Karnataka, India SatSure Full time

    Responsibilities :- Build, Lead, and Manage a team of ML researchers, Data Scientists, and Geospatial and Remote Sensing experts working in the Agriculture domain, providing guidance and mentorship- Defining career paths for team members and helping them grow with regular coaching and mentoring.- Foster a collaborative and innovative team culture,...


  • Bangalore, Karnataka, India SatSure Full time

    Responsibilities :Engineering Planning & Design :Collaborate with development teams to understand their needs and ensure that cloud-based applications and services are deployed in a consistent and reliable manner.Design, implement, and maintain cloud infrastructure for applications and services using cloud computing platforms (AWS).Participate in capacity...

  • Staff Engineer

    1 month ago


    Bangalore, Karnataka, India shenzyn Full time

    About the job :-Looking for an experienced Sr. Software Engineer to design, develop, and maintain mission- critical at-scale cloud-based geospatial data pipelines and data management environments.- Ideal candidates will have worked in a similar capacity as part of a high technology and/or data products company developing highly scalable data pipelines in the...


  • Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • TE Connectivity

    5 hours ago


    Bangalore, Karnataka, India TE Connectivity India Private Limited Full time

    About the job :At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world.Job Overview :- Responsible for designing and establishing the solution architecture for analytical platforms and/or data-enabled solutions.- Has broad understanding of the entire data and...


  • Bangalore, Karnataka, India SatSure Full time

    Roles And Responsibilities :Planning & Design : - Designing and Implementing Automated Systems : A large part of the job involves designing new automated systems. This includes understanding the business requirements. - Contributing to the development and implementation of quality assurance strategies, methodologies, and standards.- Manual Testing :...

  • Data Engineer

    5 hours ago


    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Aptus Data Labs

    5 hours ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...


  • Bangalore, Karnataka, India AVE Promagne Full time

    Role And Responsibilities:We are currently seeking a highly skilled and experienced Chief Technology Officer (CTO) to join our team in Chennai. As the CTO, you will be responsible for technology leadership and operations management, driving profitability for the business. Your key responsibilities will include:- Developing data pipelines and APIs using...


  • Bangalore, Karnataka, India SatSure Full time

    Roles & Responsibilities :- Lead design projects from conception to delivery, ensuring high-quality design solutions.- Collaborate closely with internal and external stakeholders to understand user needs, business requirements, and project goals.- Contribute to the development of design strategies that align with overall product vision and objectives.-...

  • Kafka Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • AI Data Engineer

    1 month ago


    Bangalore, Karnataka, India ApicalGo Consultancy Full time

    Primary Purpose :Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities :Data for AI...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...

  • Azure Data Engineer

    1 month ago


    Bangalore, Karnataka, India Talent Bee Consulting Pvt Ltd Full time

    About the job :Ideal Candidate :- 3+ years in Azure Data Engineering- Very good at ADF (Azure Data Factory)- Hands-on experience in designing and implementing data solutions on AzureOrganization :A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries. With a mission to enhance the efficiency of the...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Amicon Hub Full time

    Data Engineer role.Location : BangaloreNeed only Immediate Joiners and candidates from Product based/Start up Companies.Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Evaluate business needs and objectives- Interpret trends and patterns- Conduct complex data analysis and report on results - Prepare data for prescriptive...


  • Bangalore, Karnataka, India Zyoin group Full time

    Job Description :We are looking for Principal Data Engineers to help us build and enhance big data platforms to achieve availability, scalability, and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement.You will also work on the cutting edge of...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...


  • Bangalore, Karnataka, India SatSure Full time

    Responsibilities :Engineering Planning & Design :- Designing highly scalable and secure geospatial frontend platforms for web and mobile applications.- Supporting product team in facilitating daily scrum, sprint planning and retrospective meetings.- Regularly communicate with stakeholders, project managers and other developers regarding progress on the...