Requisitos : 5 years of experience - SQL, Python, Data engineering. Must have potential to develop - SQLAlchemy, NumPy. Language(s) needed : English - Conversational.
Actividades a realizar : - Build fault tolerant, high throughput data pipelines from internal and external data stores and into the data lake.
Analyze data sets for anomalies, implement robust data quality measures in code and mitigate data infrastructure down time.
Incorporate and enforce data governance policies in daily operations while working closely with the AML and Compliance teams.
Understand the development processes, styles and guides within the Data Team and minimize technical debt by writing clean, portable, modular, well documented and tested code.
Work closely with the DevOps team to manage application deployments to the Kubernetes clusters.- Monitor and understand logs through Kibana or Prometheus to identify root causes of errors and provide suggestions for fixes.
Create Kafka workers which interact with the application layer.- Gain an insight into the digital currency data sets, operations and nuances.
Understand financial reports, understand the stakeholders and understand the reporting.