Descrição do trabalho
- Data Engineer com experiencia em AWS, Python e SQL, de preferência entre 1 e 2 anos
- Conhecimentos de devops, ETL e Cloud technologies
- Se possível também com conhecimentos de :
- Pyspark
- AWS Quicksight
- Data Platform (SQL, Python) (AWS, cloud technologies)
- Developing configuration files for data ingestion in AWS.
- Developing data processing jobs in AWS.
- Managing data ingestion services in AWS.
- Investigating and resolving errors in data ingestion and processing jobs in AWS.
- Data Warehouse (SQL) (SSIS)
- Creating ETL jobs in on-prem SQL server using SSIS.
- Optimizing queries and automate processes.
- Data Products (SQL, R and Python) (Azure DevOps, Jenkins, Docker, SSIS)
- Maintaining and updating reports and dashboards in R and Python.
- Maintaining and creating deployment pipelines for reports and dashboards in Azure DevOps.
- Investigating and solving errors in reports and dashboards.
- Integrations (JS, TS, SQL) (Node.js, Jenkins, Docker)
- Implementing microservices for business logic and / or data provisioning in Node.js.
- Developing integration microservices between systems provisioned with REST API.
- Updating packages and frameworks used by a corporate API in Node.js.
- Creating and updating deployment pipelines for microservices in Docker and Azure DevOps.
- Investigating and solving errors found in integration microservices.
