Skip to content
View renanpyd's full-sized avatar
:electron:
Em casa de ferreiro, o espeto é de ferro
:electron:
Em casa de ferreiro, o espeto é de ferro

Block or report renanpyd

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
renanpyd/README.md

Renan | Data Engineering, Science, MLOps AI & Cloud Architecture

Building scalable Data Platforms • FinOps-Driven Architecture • AI Applied to Business


About

I am a Data Engineer and AI Consultant specialized in structuring data areas from scratch, transforming fragmented environments into scalable, governed and cost-efficient data platforms.

My focus is not only building pipelines — it is designing sustainable data ecosystems aligned with business strategy.

I work at the intersection of:

• Data Engineering
• Cloud Architecture
• FinOps
• Governance & Observability
• AI for Business Decision-Making


What I Deliver

Data Platform Structuring (End-to-End)

  • Architecture design (Lakehouse / Medallion)
  • Batch & Streaming pipelines
  • Data quality & validation layers
  • Anonymization & governance strategies
  • Metadata catalog & discovery integration
  • Documentation standards & access policies

FinOps Applied to Data

  • Cloud cost reduction strategies
  • Real-time monitoring & optimization
  • Workload right-sizing
  • Architecture decisions driven by efficiency

Well-architected data is not expensive. Poor architecture is.


Data-Driven Culture Implementation

  • Executive alignment meetings
  • Team onboarding & role definition
  • Evangelization of data ownership
  • Decision-making frameworks supported by analytics
  • Clear definition of responsibilities across the data lifecycle

Technology alone does not transform companies. Culture does.


Core Stack

Cloud AWS (S3, EMR, Athena, Glue, Lambda)
GCP

Engineering Python
Apache Airflow
Spark
DBT
Advanced SQL

Data Storage PostgreSQL
MySQL
DynamoDB
S3 Data Lake

APIs & Services Flask
FastAPI


Selected Solution Patterns

  • NPS Systems built in Python
  • Automated bots for operational workflows
  • API-based ingestion services with self-updating tables
  • Storytelling-driven dashboards (near real-time updates)
  • Automated segmented reporting via email
  • Structured metadata discovery (Data Catalog integration)

Architecture Principles

✔ Performance before scale
✔ Governance before exposure
✔ Cost control before expansion
✔ Documentation as part of delivery
✔ Data as a strategic asset


Open to

  • Data Platform Structuring
  • Cloud Cost Optimization (FinOps)
  • Data Governance Implementation
  • AI Strategy for Business
  • Technical Advisory for Scaling Data Teams

Contact

LinkedIn: (https://www.linkedin.com/in/limarenanandrade/)
Email: (renan.pyd@gmail.com)


Designing data ecosystems that scale with intelligence, efficiency and governance.

Popular repositories Loading

  1. Parse-.ifx Parse-.ifx Public

    Análise arquivo .IFX IBM DB2

    Jupyter Notebook 1

  2. EHS4.0---InovaTech EHS4.0---InovaTech Public

    Hackathon para desenvolvimento de soluções inovadoras para os problemas atuais na área da saúde.

    1

  3. renanpyd renanpyd Public

    TypeScript

  4. DataEngineering_Saude DataEngineering_Saude Public

    Engenharia de dados realizada com dados aberto americano (Covid)

    Jupyter Notebook

  5. Pipeline-GCP Pipeline-GCP Public

    Pipeline de Dados com Google Cloud Platform

  6. Dashboards Dashboards Public

    Modelos de dashboards