DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Using DolphinScheduler API to Achieve Efficient Batch Workflow Import and Script Deployment
chen_debra_3060b21d12b1b0 profile

Using DolphinScheduler API to Achieve Efficient Batch Workflow Import and Script Deployment

#api #programming #tooling #bigdata
5
Comments
3 min read
Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)
argha_sarkar profile

Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)

#datascience #bigdata #cloud #webdev
Comments
3 min read
Run PySpark Local Python Windows Notebook
chuongmep profile

Run PySpark Local Python Windows Notebook

#bigdata #python #spark #dataengineering
Comments
3 min read
Data formats - how and when
ashokan profile

Data formats - how and when

#csv #json #parque #bigdata
Comments
3 min read
Top 10 Tools for Efficient Web Scraping in 2025
wisdomudo profile

Top 10 Tools for Efficient Web Scraping in 2025

#webscraping #datascience #automation #bigdata
2
Comments
4 min read
Vector search using Alibaba Cloud inference API and semantic text
a_lucas profile

Vector search using Alibaba Cloud inference API and semantic text

#bigdata #elasticsearch #tutorial #api
Comments
10 min read
When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability
alexmercedcoder profile

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

#dataengineering #dataanalytics #datascience #bigdata
Comments
5 min read
Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform
mshidlov profile

Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

#bigdata #dataengineering #datascience #machinelearning
2
Comments
3 min read
Compression algorithms in Parquet Java
jerolba profile

Compression algorithms in Parquet Java

#parquet #java #compression #bigdata
5
Comments 2
7 min read
The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀
madhav_baby_giraffe profile
Madhav

The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀

#database #bigdata #dataengineering #analytics
Comments
4 min read
Rethinking distributed systems: Composability, scalability
midnattsol profile

Rethinking distributed systems: Composability, scalability

#composablearchitecture #distributedsystems #ai #bigdata
Comments
5 min read
Goodbye Kafka: Build a Low-Cost User Analysis System
ksanaka profile

Goodbye Kafka: Build a Low-Cost User Analysis System

#database #kafka #bigdata
Comments
5 min read
Query 1B Rows in PostgreSQL >25x Faster with Squirrels!
tim_huang profile

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata
Comments 8
5 min read
Introduction to Hadoop:)
madgan95 profile

Introduction to Hadoop:)

#hadoop #bigdata #nlp #llm
6
Comments
10 min read
Big Data Trends That Will Impact Your Business In 2025
td_inc profile

Big Data Trends That Will Impact Your Business In 2025

#bigdata #trends #2025 #technology
5
Comments
6 min read
The Heart of DolphinScheduler: In-Depth Analysis of the Quartz Scheduling Framework
chen_debra_3060b21d12b1b0 profile

The Heart of DolphinScheduler: In-Depth Analysis of the Quartz Scheduling Framework

#apachedolphinscheduler #quartz #opensource #bigdata
8
Comments
3 min read
SQL Filtering and Sorting with Real-life Examples
milliemolotov profile

SQL Filtering and Sorting with Real-life Examples

#database #sql #mysql #bigdata
Comments
4 min read
Big Data
williamxlr profile

Big Data

#bigdata #hadoop #spark
Comments
1 min read
Introduction to Data lakes: The future of big data storage
hiswill_thompson_e33923d1 profile

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering
5
Comments
2 min read
Construyendo una aplicación con Change Data Capture (CDC) utilizando Debezium, Kafka y NiFi
draylexter profile

Construyendo una aplicación con Change Data Capture (CDC) utilizando Debezium, Kafka y NiFi

#cdc #bigdata
1
Comments
3 min read
5 effektive Methoden, um Bilder aus Webseiten zu extrahieren
hanna_fischer_69a29e3a4c4 profile

5 effektive Methoden, um Bilder aus Webseiten zu extrahieren

#webscraping #bigdata #bilder #firefox
1
Comments
3 min read
The Apache Iceberg™ Small File Problem
thedanicafine profile

The Apache Iceberg™ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering
5
Comments
3 min read
System Design 09 - Data Partitioning: Dividing to Conquer Big Data
sarvabharan profile

System Design 09 - Data Partitioning: Dividing to Conquer Big Data

#systemdesign #bigdata #datapartition
Comments
2 min read
Understanding Star Schema vs. Snowflake Schema
puneet_verma_aa1b0f7536c6 profile

Understanding Star Schema vs. Snowflake Schema

#dataengineering #datascience #datamodeling #bigdata
Comments
1 min read
Introduction to Messaging Systems with Kafka
yasmine_ddec94f4d4 profile

Introduction to Messaging Systems with Kafka

#distributedsystems #bigdata #kafka #programming
Comments
16 min read
loading...