Dark Hacker News
new
|
best
|
ask
|
show
|
jobs
My Battle with Datetimes in Prod | Dark Hacker News
My Battle with Datetimes in Prod
(datacompose.io)
5 points
by
tccole
192 days ago
| 2 comments
tccole
192 days ago
|
next
[−]
I spent 8 hours debugging datetime parsing in a PySpark migration. Every solution failed… built-in functions returned silent NULLs, UDFs took 6 hours to run, pandas UDFs still failed on 8% of rows.
abstractspoon
191 days ago
|
next
[−]
>> Date inference is genuinely hard—there’s no universal standard
Umm, ISO is the universal standard