You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Refactor parseTimestamp method to use standard Timestamp.valueOf() first
Address PR review feedback by simplifying timestamp parsing logic:
- Try Timestamp.valueOf() on original text first
- If that fails, try with T replaced by space
- Only fall back to custom parser for complex formats
- Extract custom parsing logic to separate method for clarity
Also update NEXT_CHANGELOG.md to properly describe all changes in this PR.
Signed-off-by: josecsotomorales <[email protected]>
Copy file name to clipboardExpand all lines: NEXT_CHANGELOG.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,5 +8,7 @@
8
8
9
9
### Fixed
10
10
- Fixed timestamp values returning only milliseconds instead of the full nanosecond precision.
11
+
- Fixed complex data type conversion issues by improving StringConverter to handle Databricks complex objects (arrays/maps/structs), JDBC arrays/structs, and generic collections.
12
+
- Fixed ComplexDataTypeParser to correctly parse ISO timestamps with T separators and timezone offsets, preventing Arrow ingestion failures.
11
13
---
12
14
*Note: When making changes, please add your change under the appropriate section with a brief description.*
0 commit comments