Posts in English

Author

Affiliation

Pedro Duarte Faria

DSM-Firmenich

Writing Spark DataFrames to Elasticsearch/Opensearch databases

Elasticsearch and Opensearch are two very popular No-SQL databases. In this post, I want to address how can you write data from a Spark DataFrame into an Elasticsearch/Opensearch database.

Pedro Duarte Faria

Running an AI ChatBot locally

You might need to run an AI ChatBot (like a ChatGPT) locally on your system. In this article, I explain how you can do this.

Pedro Duarte Faria

Producing evenly-spaced and non-overlapping curves with Jobard-Lefer Algorithm in C

Flow Fields

C

Algorithm

Computer Graphcis

In this article, I want to implement the Jobard-Lefer Algorithm in C. With this algorithm, we can produce evenly-spaced and non-overlapping curves in a flow field (i.e. a vector field).

Pedro Duarte Faria

Have you ever SSH before?

SSH

Servers

Network

Do you know how SSH works? Have you ever SSH into a remote computer before? In this post I want to describe how can you login into a remote computer using SSH.

Pedro Duarte Faria

How to use the cache effectively on Apache Spark

Apache Spark

Performance

Did you ever used the DataFrame method cache() to cache your Spark DataFrame? In this post, I want to describe how you can use this method to get better performance.

Pedro Duarte Faria

My experience with `Typst`, the potential sucessor of `LaTex`

Typst

Typesetting system

Documents

Let me quickly describe my recent experience with Typst, which is a new markup-based typesetting system for composing documents and articles for science, and also, the most promissing sucessor of the famous LaTex typeset system.

Pedro Duarte Faria

NeoVim commands and shortcuts cheatsheet

NeoVim

Vim

Cheatsheet

I have been using NeoVim in this past year. However, is hard to remember all commands and shortcuts available, so I dedided to write a cheatsheet with all Vim commands and keyboard shortcuts that I use the most.

Pedro Duarte Faria

How strings work in Zig?

Zig

Strings

Encoding

A quick introduction to string literals in Zig, and how strings in Zig differ from strings in other programming languages.

Pedro Duarte Faria

Developing a parser for Python with Python

Python

Parser

This past week I had to develop a parser for Python expressions with Python. In this article, I want to use this experience to introduce the subject of parsing to beginners.

Pedro Duarte Faria

A small example on how to make better decisions with data

Data Storytelling

Data Science

This article describes a real world situation where me and my team used data to convince our client to do a better decision.

Pedro Duarte Faria

Improving decision making with Git and why you should care

Git

Decisions

Documentation

This article uses a real world situation that me and my team encountered to show how you can improve decision making in your team by tracking the decisions you make with Git

Pedro Duarte Faria

A case study about Data Storytelling at some of the largest brazilian banks

Storytelling

Data Storytelling

Data Science

This article discuss my experience on how I improved the Data Storytelling of my presentations and reports to two of the largest banks on the financial brazilian market

Pedro Duarte Faria

Introducing the `{ggfunnel}` R package

R

Package

Power BI

Funnel charts

In this post, I want to introduce an experimental R package 📦 which you can use to build Power BI like funnel charts in R.

Pedro Duarte Faria

What I learned from developing my first Python package

Python

Package

Development workflow

In this post, I want to share some of the challenges, and what I learned from developing my first Python package 📦 published at PyPI

Pedro Duarte Faria

Introducing the `{spark_map}` Python package

Python

Package

pyspark

Apache Spark

With this package, you can easily apply a function over multiple columns of a Spark DataFrame

Pedro Duarte Faria

Introducing the `{figma}` R package

R

Package

Figma

API

With this package, you can access the Figma API to bring your design files to R 🎨!

Pedro Duarte Faria

Recipient table and source table

A second view on outer joins

JOINs

Teaching

A different (maybe crazy) view on how to teach/explain Outer joins to students

Pedro Duarte Faria