Skip to main content

5/7 - AI Generated Synthetic Data

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for AI generated synthetic data
  2. Support popping a missing column from the jobs mapping table to update mappings
  3. Support searching in the subset table
  4. Support the Transform Javascript transformer on foreign keys
  5. Support for generated columns
  6. New connection page now filters to correct database type based on source connection
  7. Transformer column in the job mapping page is now searchable
  8. Support for setting the precision in the Float64 transformers
  9. Job Mapping page list boxes now take the account into consideration when filtering
  10. Added support for unique email addresses in the Email Transformers
  11. Various UI/UX refinements

4/25 - Postgres Permissions

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support and granularity for Postgres Permissions
  2. Add support for Composite keys in subsets
  3. Fixed a bug that was causing foreign keys to not entirely subset correctly
  4. Fixed a bug that was causing new columns to not show up on the job details page
  5. Updated custom javascript transformers to check for account ownership
  6. Various UI/UX refinements

4/11 - Custom Generate Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Add the ability to write custom javascript Transformers for a data generate job
  2. Transformers now filter by data type in the schema page to prevent type mismatches
  3. Add in self-service sign ups for the free tier
  4. Reduced data generation and sync time by 50%
  5. Logs in runs now are persistent, searchable and filterable
  6. Support for setting max connection limits for connections and pooled connections
  7. Added support for ON CONFLICT to handle duplicate rows
  8. Updated retry policy to fail fast instead of waiting to fail leading to better performance
  9. Update schedules to ensure that they don't get culled by Temporal
  10. Support the ability to delete, cancel or terminate runs from the Jobs page instead of having to go to Runs
  11. Various UI/UX refinements

3/28 - Partial Table Syncs

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for partial table syncs
  2. Added support for real-time validation for schema mapping
  3. Added support for permission validation for connections
  4. Added support for passing in a connection string instead of always parsing out connection parameters
  5. Added support for referential integrity in subsetting
  6. Updated schema mapping page to show unique constraints in table
  7. Updated helm charts to allow users to configure the update strategy
  8. Updated transformation logic to fail fast if transformer is unable to insert
  9. Updated transformers to have significantly more entropy
  10. Added sorting to Transformers to make it easier to search and filter
  11. Added a default schedule for jobs
  12. Various UI/UX refinements

3/14 - Metrics

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for a Supabase Integration
  2. Added the ability to easily clone a connection
  3. Updated streaming infrastructure to used pooled connections for more efficient data transfer
  4. Added a product tour checklist to make onboarding easier
  5. Added more UI support for foreign key transformations
  6. Implemented Keycloak for authentication and removed Auth0
  7. Other UI/UX refinements

2/29 - Foreign Key Transformations

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Support primary key and foreign key transformations
  2. Include constraints in Schema table for filtering, searching, sorting
  3. Update SSH tunnel session sharing to be much more efficient
  4. Update job details to surface an error if the job times out
  5. Add isNullable column to the Schema table
  6. Add regular expression to character scramble transformer
  7. Update sync job to handle reserved keyword columns
  8. Handle column lengths in data generation so that we never overflow a column
  9. Fixed a bug that broke the data generation form when you switch tables
  10. UI/UX refinements

2/15 - Terraform

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Release of the Neosync Terraform provider
  2. Updated Job clean up to handle if Temporal schedule fails to be created
  3. Updated Transform Email transformer to take in an exclusion list of domains
  4. Added more granular options for Job tries and timeouts in Job definition
  5. Updated logging to have a cleaner format and include more logs
  6. Fixed a bug that was causing the Connect page to refresh and lose state
  7. UI/UX refinements

2/01 - Circular Dependencies

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Support for intra-table and inter-table circular dependencies
  2. Data sync logs in the app for k8 deployments
  3. Introduced more granular timeout settings for jobs
  4. Support for tunneling into DBs in private VPCs via bastion host tunneling
  5. Support for HPA in Neosync helm charts
  6. Introduced a Transform Character Scramble transformer thats scrambles a string while keep spaces, punctuation and format constant
  7. Transformer names are now clickable in the transformers table
  8. More tests for circular dependency support
  9. Fixed a bug causing the bulk update and filter functionality in the schema table to be flaky
  10. UI/UX refinements

1/18 - Conditional Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Released Conditional Transformers
  2. Released support for Categorical Transformers
  3. Added search to docs by Algolia
  4. Added HOSTNAME env var to app service in Docker Compose for better local dev experience
  5. Added support for selecting a file system connection
  6. Fixed a bug that caused the auth token to expire
  7. Fixed a bug causing table pagination to revert back to the first page on re-render
  8. Refactored some transformers (random_float_64, random_int_64, random_string) for performance improvements
  9. Added more tests for circular dependencies and table constraints
  10. UI/UX refinements

1/04 - Custom Code Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Released Custom Code Transformers
  2. Improved benthos performance by 30% on data sync
  3. Added new list connections command to the CLI
  4. Created a new compose file that uses production images
  5. Added a length param to the float64 transformer
  6. Updated transformer filtering to filter by name instead of source
  7. Fixed a bug that didn't allow users to create new jobs in auth mode
  8. Updated tables so that the table links work appropriately
  9. Updated documentation for setting up Authentication
  10. Enable auth token refreshing in the CLI
  11. Updated page routing to always route /account/settings to temporal page
  12. UI/UX refinements