jolt is convert large number into scientific notation

[yhjhoo]

input

{
  "rating": {
    "primary": {
      "value": 60000000.1
    },
    "quality": {
      "value": 3
    }
  }
}

spec

[
  {
    "operation": "shift",
    "spec": {
      "rating": {
        "primary": {
          // simple match.  Put the value '4' in the output under the "Rating" field
          "value": "Rating"
        }
      }
    }
  }
]

ouput:

{
  "Rating" : 6.00000001E7
}

Expected output

{
  "Rating" : 60000000.1
}

[emmansun]

Jolt used jackson for json process. You can write one own function to serialize the object to json string.

    ObjectMapper objectMapper = new ObjectMapper();
    // Register custom serializer for Double
    SimpleModule module = new SimpleModule();
    module.addSerializer(Double.class, new CustomDoubleSerializer());
    objectMapper.registerModule(module);

    JsonUtil jsonUtil = JsonUtils.customJsonUtil(mapper);

    static class CustomDoubleSerializer extends StdSerializer<Double> {
        private static final DecimalFormat decimalFormat = new DecimalFormat("0.################");
        public CustomDoubleSerializer() {
            super(Double.class);
        }

        @Override
        public void serialize(Double value, JsonGenerator gen, SerializerProvider provider) throws IOException {
            gen.writeNumber(decimalFormat.format(value));
        }
    }

If jolt needs to support it, then there are 2 options:

1. With objectMapper.enable(DeserializationFeature.USE_BIG_DECIMAL_FOR_FLOATS);, configures ObjectMapper to deserialize floating-point numbers as BigDecimal. this changed the internal object representation, some test cases will be failed, needs more test, especially for json-util and Modifier transform.

2. Implement one custom serializer, serialize double value with non-scientific notation. This option just impact output.Sample CustomDoubleSerializer:

    // Custom serializer for Double
    static class CustomDoubleSerializer extends StdSerializer<Double> {
        private static final DecimalFormat decimalFormat = new DecimalFormat("0.################");
        public CustomDoubleSerializer() {
            super(Double.class);
        }

        @Override
        public void serialize(Double value, JsonGenerator gen, SerializerProvider provider) throws IOException {
            gen.writeNumber(decimalFormat.format(value));
        }
    }

both options will update configureStockJoltObjectMapper method in JsonUtilImpl.