Skip to main content

8/01 - DynamoDB

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. First class support for integrating with DynamoDB
  2. Fixed a bug that was causing some Redis values to not get cleaned up
  3. Update generate_state transformer to return full state names as an option
  4. Add role permissions to MYSQL connection
  5. Improve mysql init schema options to resolve circular dependencies
  6. Add auto-complete to custom javascript transformers
  7. Update Connect page to ensure that users only select valid destinations based on the source connection
  8. Support subsetting within DynamoDB
  9. Update integration tests to parallelize
  10. Fix a rare data race issue that occurs in Benthos

7/18 - Base Transformers in Custom Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Support for accessing transformers within custom javascript transformers
  2. Fixed a bug within the init schema option that occurred when a sequence already existed
  3. Updated Mysql connection to be more flexible and handle URL parsing
  4. Updated docs to include auto-generated docs for transformers in custom transformers

7/04 - Job Cloning

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb TLS certificates for TLS
  2. Added support for MongoDb connection pooling
  3. Added support for the ability to clone a job
  4. Added support for Google Cloud Storage as a destination connection
  5. Added support for publishing to Artifact hub
  6. Added a batch size config option to the OpenAI generator
  7. Added support for being able to use generators and transformers inside of the javascript transformers
  8. Better handling of OpenAI generator token limits
  9. Added support for configuring sidecars in helm charts

6/20 - MongoDb

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb as a connection
  2. Updated Linux support so that you can run the gen.sh script to stand up environment locally
  3. Updated Supabase connection to pull in the schema role permission correctly
  4. Updated worker to handle newer SQL compliant syntax for defining auto-incrementing columns
  5. Added support for identity columns in Postgres
  6. Updated circular dependencies to handle complex dependencies with subsets

6/06 - Real time schema validation

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for Postgres Client Certificates
  2. Added support for creating table indices on init
  3. Added support for real time constraint validation
  4. Added an option to the email transformer to handle invalid email addresses
  5. Added root label to the subset page to denote root tables for subsetting
  6. Added button to get the row count of a subsetted table
  7. Added support for Postgres custom datatypes/functions/sequences etc
  8. Added support for column auto-complete within subsetted
  9. Fixed a bug that was causing mysql system queries to use int32 instead of int64
  10. Various UI/UX refinements

5/23 - Flexible Schema References

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for JSONB columns in subsetting section
  2. Updated error handling to be more responsive in worker
  3. Fixed a bug that was causing the init schema to skip on generate jobs
  4. Update Terraform provider to retrieve system transformer by source
  5. Exposed a logout Url override in the helm chart
  6. Added support for Float transformer precision
  7. Added support for unique email addresses in email transformer
  8. Fixed a bug that was causing truncate to fail before an insert when there was only a single table
  9. Added support for selecting a different connection that we pull the schema from which doesn't have to be the destination
  10. Various UI/UX refinements

5/7 - AI Generated Synthetic Data

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for AI generated synthetic data
  2. Support popping a missing column from the jobs mapping table to update mappings
  3. Support searching in the subset table
  4. Support the Transform Javascript transformer on foreign keys
  5. Support for generated columns
  6. New connection page now filters to correct database type based on source connection
  7. Transformer column in the job mapping page is now searchable
  8. Support for setting the precision in the Float64 transformers
  9. Job Mapping page list boxes now take the account into consideration when filtering
  10. Added support for unique email addresses in the Email Transformers
  11. Various UI/UX refinements

4/25 - Postgres Permissions

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support and granularity for Postgres Permissions
  2. Add support for Composite keys in subsets
  3. Fixed a bug that was causing foreign keys to not entirely subset correctly
  4. Fixed a bug that was causing new columns to not show up on the job details page
  5. Updated custom javascript transformers to check for account ownership
  6. Various UI/UX refinements

4/11 - Custom Generate Transformers

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Add the ability to write custom javascript Transformers for a data generate job
  2. Transformers now filter by data type in the schema page to prevent type mismatches
  3. Add in self-service sign ups for the free tier
  4. Reduced data generation and sync time by 50%
  5. Logs in runs now are persistent, searchable and filterable
  6. Support for setting max connection limits for connections and pooled connections
  7. Added support for ON CONFLICT to handle duplicate rows
  8. Updated retry policy to fail fast instead of waiting to fail leading to better performance
  9. Update schedules to ensure that they don't get culled by Temporal
  10. Support the ability to delete, cancel or terminate runs from the Jobs page instead of having to go to Runs
  11. Various UI/UX refinements

3/28 - Partial Table Syncs

· One min read
Evis Drenova
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for partial table syncs
  2. Added support for real-time validation for schema mapping
  3. Added support for permission validation for connections
  4. Added support for passing in a connection string instead of always parsing out connection parameters
  5. Added support for referential integrity in subsetting
  6. Updated schema mapping page to show unique constraints in table
  7. Updated helm charts to allow users to configure the update strategy
  8. Updated transformation logic to fail fast if transformer is unable to insert
  9. Updated transformers to have significantly more entropy
  10. Added sorting to Transformers to make it easier to search and filter
  11. Added a default schedule for jobs
  12. Various UI/UX refinements